Jul 08 17:33:20.124964 ip-10-0-130-38 systemd[1]: Starting Kubernetes Kubelet... Jul 08 17:33:20.554061 ip-10-0-130-38 kubenswrapper[2552]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 17:33:20.554061 ip-10-0-130-38 kubenswrapper[2552]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 08 17:33:20.554061 ip-10-0-130-38 kubenswrapper[2552]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 17:33:20.554061 ip-10-0-130-38 kubenswrapper[2552]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 08 17:33:20.554061 ip-10-0-130-38 kubenswrapper[2552]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 17:33:20.556347 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.556204 2552 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 08 17:33:20.562940 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.562918 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:33:20.562940 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.562935 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:33:20.562940 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.562939 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:33:20.562940 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.562942 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:33:20.562940 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.562946 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:33:20.563130 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.562950 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:33:20.563130 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.562953 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:33:20.563130 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.562956 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:33:20.563130 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.562958 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:33:20.563130 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.562961 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:33:20.563130 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.562963 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:33:20.563130 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.562966 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:33:20.563130 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.562969 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:33:20.563130 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.562971 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:33:20.563130 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.562974 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:33:20.563130 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.562976 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:33:20.563130 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.562979 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:33:20.563130 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.562981 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:33:20.563130 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.562984 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:33:20.563130 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.562986 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:33:20.563130 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.562989 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:33:20.563130 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.562991 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:33:20.563130 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.562994 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:33:20.563130 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.562996 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:33:20.563130 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563005 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:33:20.563614 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563008 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:33:20.563614 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563010 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:33:20.563614 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563012 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:33:20.563614 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563015 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:33:20.563614 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563017 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:33:20.563614 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563020 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:33:20.563614 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563022 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:33:20.563614 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563025 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:33:20.563614 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563027 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:33:20.563614 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563029 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:33:20.563614 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563032 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:33:20.563614 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563034 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:33:20.563614 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563036 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:33:20.563614 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563039 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:33:20.563614 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563042 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:33:20.563614 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563044 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:33:20.563614 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563047 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:33:20.563614 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563050 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:33:20.563614 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563052 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:33:20.564086 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563055 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:33:20.564086 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563057 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:33:20.564086 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563059 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:33:20.564086 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563062 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:33:20.564086 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563066 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:33:20.564086 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563070 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:33:20.564086 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563074 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:33:20.564086 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563076 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:33:20.564086 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563079 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:33:20.564086 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563081 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:33:20.564086 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563084 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:33:20.564086 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563086 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:33:20.564086 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563089 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:33:20.564086 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563092 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:33:20.564086 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563094 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:33:20.564086 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563096 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:33:20.564086 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563098 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:33:20.564086 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563101 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:33:20.564086 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563103 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:33:20.564582 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563106 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:33:20.564582 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563108 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:33:20.564582 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563111 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:33:20.564582 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563113 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:33:20.564582 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563116 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:33:20.564582 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563118 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:33:20.564582 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563120 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:33:20.564582 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563124 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:33:20.564582 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563126 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:33:20.564582 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563129 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:33:20.564582 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563131 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:33:20.564582 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563135 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:33:20.564582 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563139 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:33:20.564582 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563142 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:33:20.564582 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563145 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:33:20.564582 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563148 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:33:20.564582 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563152 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:33:20.564582 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563154 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:33:20.564582 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563157 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:33:20.565072 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563159 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:33:20.565072 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563162 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:33:20.565072 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563164 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:33:20.565072 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563167 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:33:20.565072 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563169 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:33:20.565072 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563172 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:33:20.565072 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563174 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:33:20.565072 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563178 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:33:20.565072 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563180 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:33:20.565072 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563184 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:33:20.565072 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563188 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:33:20.565072 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563190 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:33:20.565072 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563193 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:33:20.565072 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563195 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:33:20.565072 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563197 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:33:20.565072 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563200 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:33:20.565072 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563202 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:33:20.565072 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563901 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:33:20.565072 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563907 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:33:20.565072 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563910 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:33:20.565557 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563914 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:33:20.565557 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563917 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:33:20.565557 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563920 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:33:20.565557 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563922 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:33:20.565557 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563925 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:33:20.565557 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563929 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:33:20.565557 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563933 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:33:20.565557 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563937 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:33:20.565557 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563940 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:33:20.565557 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563942 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:33:20.565557 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563945 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:33:20.565557 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563948 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:33:20.565557 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563951 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:33:20.565557 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563954 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:33:20.565557 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563958 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:33:20.565557 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563961 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:33:20.565557 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563963 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:33:20.565557 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563966 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:33:20.565557 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563969 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:33:20.566049 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563973 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:33:20.566049 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563977 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:33:20.566049 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563980 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:33:20.566049 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563982 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:33:20.566049 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563985 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:33:20.566049 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563987 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:33:20.566049 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563990 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:33:20.566049 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563993 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:33:20.566049 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563995 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:33:20.566049 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.563998 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:33:20.566049 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564000 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:33:20.566049 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564003 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:33:20.566049 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564006 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:33:20.566049 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564009 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:33:20.566049 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564012 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:33:20.566049 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564015 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:33:20.566049 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564017 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:33:20.566049 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564020 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:33:20.566049 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564022 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:33:20.566049 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564024 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:33:20.566525 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564027 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:33:20.566525 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564029 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:33:20.566525 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564032 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:33:20.566525 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564035 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:33:20.566525 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564037 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:33:20.566525 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564040 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:33:20.566525 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564042 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:33:20.566525 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564045 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:33:20.566525 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564048 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:33:20.566525 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564050 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:33:20.566525 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564053 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:33:20.566525 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564055 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:33:20.566525 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564058 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:33:20.566525 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564060 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:33:20.566525 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564062 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:33:20.566525 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564065 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:33:20.566525 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564067 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:33:20.566525 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564069 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:33:20.566525 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564072 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:33:20.566525 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564074 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:33:20.567021 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564076 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:33:20.567021 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564079 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:33:20.567021 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564081 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:33:20.567021 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564083 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:33:20.567021 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564089 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:33:20.567021 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564092 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:33:20.567021 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564096 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:33:20.567021 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564099 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:33:20.567021 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564101 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:33:20.567021 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564104 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:33:20.567021 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564107 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:33:20.567021 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564110 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:33:20.567021 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564113 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:33:20.567021 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564116 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:33:20.567021 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564118 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:33:20.567021 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564121 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:33:20.567021 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564124 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:33:20.567021 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564127 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:33:20.567021 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564130 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:33:20.567466 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564132 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:33:20.567466 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564135 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:33:20.567466 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564138 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:33:20.567466 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564141 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:33:20.567466 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564144 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:33:20.567466 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564147 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:33:20.567466 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564150 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:33:20.567466 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564153 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:33:20.567466 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564155 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:33:20.567466 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564158 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:33:20.567466 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564160 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:33:20.567466 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564163 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:33:20.567466 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564166 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:33:20.567466 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564168 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:33:20.567466 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564171 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:33:20.567466 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564174 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:33:20.567466 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564176 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:33:20.567466 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564179 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:33:20.567466 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564577 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:33:20.567466 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564582 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:33:20.567964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564586 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:33:20.567964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564589 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:33:20.567964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564592 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:33:20.567964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564595 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:33:20.567964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564598 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:33:20.567964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564601 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:33:20.567964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564603 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:33:20.567964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564606 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:33:20.567964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564608 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:33:20.567964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564610 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:33:20.567964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564613 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:33:20.567964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564615 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:33:20.567964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564634 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:33:20.567964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564637 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:33:20.567964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564640 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:33:20.567964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564643 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:33:20.567964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564645 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:33:20.567964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564647 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:33:20.567964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564650 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:33:20.567964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564652 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:33:20.568442 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564655 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:33:20.568442 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564658 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:33:20.568442 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564660 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:33:20.568442 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564663 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:33:20.568442 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564665 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:33:20.568442 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564668 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:33:20.568442 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564670 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:33:20.568442 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564672 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:33:20.568442 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564675 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:33:20.568442 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564678 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:33:20.568442 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564681 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:33:20.568442 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564684 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:33:20.568442 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564686 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:33:20.568442 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564689 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:33:20.568442 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564692 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:33:20.568442 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564694 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:33:20.568442 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564697 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:33:20.568442 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564699 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:33:20.568442 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564702 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:33:20.568442 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564704 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:33:20.569000 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564707 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:33:20.569000 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564709 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:33:20.569000 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564711 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:33:20.569000 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564714 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:33:20.569000 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564716 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:33:20.569000 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564719 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:33:20.569000 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564723 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:33:20.569000 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564727 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:33:20.569000 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564730 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:33:20.569000 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564732 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:33:20.569000 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564735 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:33:20.569000 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564738 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:33:20.569000 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564741 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:33:20.569000 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564743 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:33:20.569000 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564746 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:33:20.569000 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564749 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:33:20.569000 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564753 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:33:20.569000 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564756 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:33:20.569000 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564758 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:33:20.569000 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564760 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:33:20.569491 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564763 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:33:20.569491 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564765 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:33:20.569491 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564768 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:33:20.569491 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564771 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:33:20.569491 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564773 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:33:20.569491 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564776 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:33:20.569491 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564778 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:33:20.569491 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564780 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:33:20.569491 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564783 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:33:20.569491 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564785 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:33:20.569491 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564788 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:33:20.569491 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564793 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:33:20.569491 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564796 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:33:20.569491 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564799 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:33:20.569491 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564802 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:33:20.569491 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564804 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:33:20.569491 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564807 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:33:20.569491 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564809 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:33:20.569491 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564812 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:33:20.569965 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564814 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:33:20.569965 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564817 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:33:20.569965 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564819 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:33:20.569965 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564822 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:33:20.569965 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564824 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:33:20.569965 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564826 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:33:20.569965 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564829 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:33:20.569965 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564831 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:33:20.569965 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564833 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:33:20.569965 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564836 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:33:20.569965 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564838 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:33:20.569965 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564840 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:33:20.569965 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564843 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:33:20.569965 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564848 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:33:20.569965 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564850 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:33:20.569965 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564854 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:33:20.569965 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564857 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:33:20.569965 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.564859 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:33:20.569965 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.564924 2552 flags.go:64] FLAG: --address="0.0.0.0" Jul 08 17:33:20.569965 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.564936 2552 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 08 17:33:20.570447 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.564943 2552 flags.go:64] FLAG: --anonymous-auth="true" Jul 08 17:33:20.570447 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.564949 2552 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 08 17:33:20.570447 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.564956 2552 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 08 17:33:20.570447 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.564961 2552 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 08 17:33:20.570447 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.564967 2552 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 08 17:33:20.570447 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.564975 2552 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 08 17:33:20.570447 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.564978 2552 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 08 17:33:20.570447 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.564981 2552 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 08 17:33:20.570447 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.564985 2552 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 08 17:33:20.570447 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.564988 2552 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 08 17:33:20.570447 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.564991 2552 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 08 17:33:20.570447 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.564993 2552 flags.go:64] FLAG: --cgroup-root="" Jul 08 17:33:20.570447 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.564996 2552 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 08 17:33:20.570447 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.564999 2552 flags.go:64] FLAG: --client-ca-file="" Jul 08 17:33:20.570447 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565002 2552 flags.go:64] FLAG: --cloud-provider="external" Jul 08 17:33:20.570447 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565005 2552 flags.go:64] FLAG: --cluster-dns="[]" Jul 08 17:33:20.570447 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565008 2552 flags.go:64] FLAG: --cluster-domain="" Jul 08 17:33:20.570447 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565011 2552 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 08 17:33:20.570447 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565014 2552 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 08 17:33:20.570447 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565017 2552 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 08 17:33:20.570447 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565020 2552 flags.go:64] FLAG: --container-log-max-files="5" Jul 08 17:33:20.570447 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565023 2552 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 08 17:33:20.570447 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565026 2552 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 08 17:33:20.571008 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565029 2552 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 08 17:33:20.571008 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565032 2552 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 08 17:33:20.571008 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565036 2552 flags.go:64] FLAG: --contention-profiling="false" Jul 08 17:33:20.571008 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565039 2552 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 08 17:33:20.571008 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565043 2552 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 08 17:33:20.571008 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565046 2552 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 08 17:33:20.571008 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565048 2552 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 08 17:33:20.571008 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565052 2552 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 08 17:33:20.571008 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565055 2552 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 08 17:33:20.571008 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565058 2552 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 08 17:33:20.571008 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565061 2552 flags.go:64] FLAG: --enable-load-reader="false" Jul 08 17:33:20.571008 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565063 2552 flags.go:64] FLAG: --enable-server="true" Jul 08 17:33:20.571008 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565066 2552 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 08 17:33:20.571008 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565070 2552 flags.go:64] FLAG: --event-burst="100" Jul 08 17:33:20.571008 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565073 2552 flags.go:64] FLAG: --event-qps="50" Jul 08 17:33:20.571008 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565076 2552 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 08 17:33:20.571008 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565079 2552 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 08 17:33:20.571008 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565082 2552 flags.go:64] FLAG: --eviction-hard="" Jul 08 17:33:20.571008 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565085 2552 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 08 17:33:20.571008 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565088 2552 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 08 17:33:20.571008 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565091 2552 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 08 17:33:20.571008 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565093 2552 flags.go:64] FLAG: --eviction-soft="" Jul 08 17:33:20.571008 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565096 2552 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 08 17:33:20.571008 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565099 2552 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 08 17:33:20.571008 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565102 2552 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 08 17:33:20.571610 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565105 2552 flags.go:64] FLAG: --experimental-mounter-path="" Jul 08 17:33:20.571610 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565108 2552 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 08 17:33:20.571610 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565110 2552 flags.go:64] FLAG: --fail-swap-on="true" Jul 08 17:33:20.571610 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565113 2552 flags.go:64] FLAG: --feature-gates="" Jul 08 17:33:20.571610 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565117 2552 flags.go:64] FLAG: --file-check-frequency="20s" Jul 08 17:33:20.571610 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565119 2552 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 08 17:33:20.571610 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565122 2552 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 08 17:33:20.571610 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565125 2552 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 08 17:33:20.571610 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565128 2552 flags.go:64] FLAG: --healthz-port="10248" Jul 08 17:33:20.571610 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565132 2552 flags.go:64] FLAG: --help="false" Jul 08 17:33:20.571610 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565135 2552 flags.go:64] FLAG: --hostname-override="ip-10-0-130-38.ec2.internal" Jul 08 17:33:20.571610 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565140 2552 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 08 17:33:20.571610 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565143 2552 flags.go:64] FLAG: --http-check-frequency="20s" Jul 08 17:33:20.571610 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565146 2552 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 08 17:33:20.571610 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565149 2552 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 08 17:33:20.571610 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565152 2552 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 08 17:33:20.571610 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565161 2552 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 08 17:33:20.571610 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565164 2552 flags.go:64] FLAG: --image-service-endpoint="" Jul 08 17:33:20.571610 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565166 2552 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 08 17:33:20.571610 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565169 2552 flags.go:64] FLAG: --kube-api-burst="100" Jul 08 17:33:20.571610 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565172 2552 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 08 17:33:20.571610 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565175 2552 flags.go:64] FLAG: --kube-api-qps="50" Jul 08 17:33:20.571610 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565178 2552 flags.go:64] FLAG: --kube-reserved="" Jul 08 17:33:20.571610 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565181 2552 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 08 17:33:20.572254 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565183 2552 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 08 17:33:20.572254 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565186 2552 flags.go:64] FLAG: --kubelet-cgroups="" Jul 08 17:33:20.572254 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565188 2552 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 08 17:33:20.572254 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565191 2552 flags.go:64] FLAG: --lock-file="" Jul 08 17:33:20.572254 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565194 2552 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 08 17:33:20.572254 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565197 2552 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 08 17:33:20.572254 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565199 2552 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 08 17:33:20.572254 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565205 2552 flags.go:64] FLAG: --log-json-split-stream="false" Jul 08 17:33:20.572254 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565208 2552 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 08 17:33:20.572254 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565211 2552 flags.go:64] FLAG: --log-text-split-stream="false" Jul 08 17:33:20.572254 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565213 2552 flags.go:64] FLAG: --logging-format="text" Jul 08 17:33:20.572254 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565216 2552 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 08 17:33:20.572254 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565219 2552 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 08 17:33:20.572254 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565222 2552 flags.go:64] FLAG: --manifest-url="" Jul 08 17:33:20.572254 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565224 2552 flags.go:64] FLAG: --manifest-url-header="" Jul 08 17:33:20.572254 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565228 2552 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 08 17:33:20.572254 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565231 2552 flags.go:64] FLAG: --max-open-files="1000000" Jul 08 17:33:20.572254 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565236 2552 flags.go:64] FLAG: --max-pods="110" Jul 08 17:33:20.572254 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565238 2552 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 08 17:33:20.572254 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565243 2552 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 08 17:33:20.572254 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565245 2552 flags.go:64] FLAG: --memory-manager-policy="None" Jul 08 17:33:20.572254 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565248 2552 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 08 17:33:20.572254 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565251 2552 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 08 17:33:20.572254 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565254 2552 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 08 17:33:20.572254 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565257 2552 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 08 17:33:20.572955 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565263 2552 flags.go:64] FLAG: --node-status-max-images="50" Jul 08 17:33:20.572955 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565266 2552 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 08 17:33:20.572955 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565269 2552 flags.go:64] FLAG: --oom-score-adj="-999" Jul 08 17:33:20.572955 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565271 2552 flags.go:64] FLAG: --pod-cidr="" Jul 08 17:33:20.572955 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565274 2552 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 08 17:33:20.572955 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565280 2552 flags.go:64] FLAG: --pod-manifest-path="" Jul 08 17:33:20.572955 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565282 2552 flags.go:64] FLAG: --pod-max-pids="-1" Jul 08 17:33:20.572955 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565285 2552 flags.go:64] FLAG: --pods-per-core="0" Jul 08 17:33:20.572955 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565288 2552 flags.go:64] FLAG: --port="10250" Jul 08 17:33:20.572955 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565291 2552 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 08 17:33:20.572955 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565293 2552 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-072570ec0ead126ff" Jul 08 17:33:20.572955 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565296 2552 flags.go:64] FLAG: --qos-reserved="" Jul 08 17:33:20.572955 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565299 2552 flags.go:64] FLAG: --read-only-port="10255" Jul 08 17:33:20.572955 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565312 2552 flags.go:64] FLAG: --register-node="true" Jul 08 17:33:20.572955 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565315 2552 flags.go:64] FLAG: --register-with-taints="" Jul 08 17:33:20.572955 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565318 2552 flags.go:64] FLAG: --registry-burst="10" Jul 08 17:33:20.572955 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565322 2552 flags.go:64] FLAG: --registry-qps="5" Jul 08 17:33:20.572955 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565324 2552 flags.go:64] FLAG: --reserved-cpus="" Jul 08 17:33:20.572955 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565327 2552 flags.go:64] FLAG: --reserved-memory="" Jul 08 17:33:20.572955 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565331 2552 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 08 17:33:20.572955 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565333 2552 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 08 17:33:20.572955 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565336 2552 flags.go:64] FLAG: --rotate-certificates="false" Jul 08 17:33:20.572955 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565339 2552 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 08 17:33:20.572955 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565341 2552 flags.go:64] FLAG: --runonce="false" Jul 08 17:33:20.572955 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565345 2552 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 08 17:33:20.573569 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565348 2552 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 08 17:33:20.573569 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565351 2552 flags.go:64] FLAG: --seccomp-default="false" Jul 08 17:33:20.573569 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565355 2552 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 08 17:33:20.573569 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565357 2552 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 08 17:33:20.573569 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565360 2552 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 08 17:33:20.573569 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565363 2552 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 08 17:33:20.573569 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565366 2552 flags.go:64] FLAG: --storage-driver-password="root" Jul 08 17:33:20.573569 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565369 2552 flags.go:64] FLAG: --storage-driver-secure="false" Jul 08 17:33:20.573569 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565372 2552 flags.go:64] FLAG: --storage-driver-table="stats" Jul 08 17:33:20.573569 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565374 2552 flags.go:64] FLAG: --storage-driver-user="root" Jul 08 17:33:20.573569 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565377 2552 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 08 17:33:20.573569 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565380 2552 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 08 17:33:20.573569 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565383 2552 flags.go:64] FLAG: --system-cgroups="" Jul 08 17:33:20.573569 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565385 2552 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 08 17:33:20.573569 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565390 2552 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 08 17:33:20.573569 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565393 2552 flags.go:64] FLAG: --tls-cert-file="" Jul 08 17:33:20.573569 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565396 2552 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 08 17:33:20.573569 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565399 2552 flags.go:64] FLAG: --tls-min-version="" Jul 08 17:33:20.573569 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565402 2552 flags.go:64] FLAG: --tls-private-key-file="" Jul 08 17:33:20.573569 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565404 2552 flags.go:64] FLAG: --topology-manager-policy="none" Jul 08 17:33:20.573569 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565407 2552 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 08 17:33:20.573569 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565410 2552 flags.go:64] FLAG: --topology-manager-scope="container" Jul 08 17:33:20.573569 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565412 2552 flags.go:64] FLAG: --v="2" Jul 08 17:33:20.573569 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565416 2552 flags.go:64] FLAG: --version="false" Jul 08 17:33:20.573569 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565420 2552 flags.go:64] FLAG: --vmodule="" Jul 08 17:33:20.574179 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565423 2552 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 08 17:33:20.574179 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.565426 2552 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 08 17:33:20.574179 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565541 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:33:20.574179 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565544 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:33:20.574179 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565547 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:33:20.574179 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565550 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:33:20.574179 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565555 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:33:20.574179 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565558 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:33:20.574179 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565561 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:33:20.574179 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565565 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:33:20.574179 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565568 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:33:20.574179 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565571 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:33:20.574179 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565574 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:33:20.574179 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565577 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:33:20.574179 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565580 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:33:20.574179 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565582 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:33:20.574179 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565584 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:33:20.574179 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565587 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:33:20.574179 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565589 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:33:20.574179 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565592 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:33:20.574685 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565594 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:33:20.574685 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565597 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:33:20.574685 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565601 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:33:20.574685 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565604 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:33:20.574685 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565607 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:33:20.574685 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565609 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:33:20.574685 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565612 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:33:20.574685 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565614 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:33:20.574685 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565633 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:33:20.574685 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565636 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:33:20.574685 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565640 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:33:20.574685 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565643 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:33:20.574685 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565646 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:33:20.574685 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565649 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:33:20.574685 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565652 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:33:20.574685 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565654 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:33:20.574685 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565657 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:33:20.574685 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565660 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:33:20.574685 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565667 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:33:20.575152 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565670 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:33:20.575152 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565672 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:33:20.575152 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565676 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:33:20.575152 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565679 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:33:20.575152 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565681 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:33:20.575152 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565684 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:33:20.575152 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565686 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:33:20.575152 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565689 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:33:20.575152 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565691 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:33:20.575152 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565694 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:33:20.575152 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565697 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:33:20.575152 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565699 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:33:20.575152 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565703 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:33:20.575152 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565707 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:33:20.575152 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565709 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:33:20.575152 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565712 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:33:20.575152 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565714 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:33:20.575152 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565717 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:33:20.575152 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565720 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:33:20.575152 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565722 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:33:20.575646 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565724 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:33:20.575646 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565727 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:33:20.575646 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565729 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:33:20.575646 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565732 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:33:20.575646 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565734 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:33:20.575646 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565736 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:33:20.575646 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565739 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:33:20.575646 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565742 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:33:20.575646 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565744 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:33:20.575646 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565746 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:33:20.575646 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565749 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:33:20.575646 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565753 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:33:20.575646 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565756 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:33:20.575646 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565758 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:33:20.575646 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565762 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:33:20.575646 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565765 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:33:20.575646 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565767 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:33:20.575646 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565770 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:33:20.575646 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565772 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:33:20.575646 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565775 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:33:20.576140 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565777 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:33:20.576140 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565780 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:33:20.576140 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565782 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:33:20.576140 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565784 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:33:20.576140 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565786 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:33:20.576140 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565789 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:33:20.576140 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565791 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:33:20.576140 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565794 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:33:20.576140 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565796 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:33:20.576140 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565799 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:33:20.576140 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565801 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:33:20.576140 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565804 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:33:20.576140 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565806 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:33:20.576140 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565809 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:33:20.576140 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565811 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:33:20.576140 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565814 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:33:20.576140 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565817 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:33:20.576140 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565819 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:33:20.576140 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565822 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:33:20.576597 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565825 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:33:20.576597 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565827 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:33:20.576597 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.565830 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:33:20.576597 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.566611 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 17:33:20.576597 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.573765 2552 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 08 17:33:20.576597 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.573782 2552 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 08 17:33:20.576597 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.573800 2552 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 08 17:33:20.576597 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.573805 2552 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 08 17:33:20.576597 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573860 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:33:20.576597 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573866 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:33:20.576597 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573871 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:33:20.576597 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573874 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:33:20.576597 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573877 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:33:20.576597 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573880 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:33:20.576964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573883 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:33:20.576964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573885 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:33:20.576964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573888 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:33:20.576964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573891 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:33:20.576964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573893 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:33:20.576964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573896 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:33:20.576964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573898 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:33:20.576964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573901 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:33:20.576964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573904 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:33:20.576964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573906 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:33:20.576964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573910 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:33:20.576964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573913 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:33:20.576964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573916 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:33:20.576964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573919 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:33:20.576964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573922 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:33:20.576964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573924 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:33:20.576964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573927 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:33:20.576964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573930 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:33:20.576964 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573932 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:33:20.577441 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573935 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:33:20.577441 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573937 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:33:20.577441 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573940 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:33:20.577441 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573942 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:33:20.577441 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573946 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:33:20.577441 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573948 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:33:20.577441 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573951 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:33:20.577441 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573954 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:33:20.577441 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573956 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:33:20.577441 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573958 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:33:20.577441 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573961 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:33:20.577441 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573964 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:33:20.577441 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573966 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:33:20.577441 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573969 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:33:20.577441 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573971 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:33:20.577441 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573974 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:33:20.577441 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573976 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:33:20.577441 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573978 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:33:20.577441 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573981 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:33:20.577914 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573983 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:33:20.577914 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573986 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:33:20.577914 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573988 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:33:20.577914 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573991 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:33:20.577914 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573993 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:33:20.577914 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573996 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:33:20.577914 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.573998 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:33:20.577914 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574000 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:33:20.577914 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574003 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:33:20.577914 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574006 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:33:20.577914 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574008 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:33:20.577914 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574010 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:33:20.577914 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574013 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:33:20.577914 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574015 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:33:20.577914 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574018 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:33:20.577914 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574020 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:33:20.577914 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574022 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:33:20.577914 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574026 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:33:20.577914 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574029 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:33:20.577914 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574031 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:33:20.578433 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574034 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:33:20.578433 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574037 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:33:20.578433 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574039 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:33:20.578433 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574041 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:33:20.578433 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574044 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:33:20.578433 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574046 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:33:20.578433 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574049 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:33:20.578433 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574051 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:33:20.578433 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574054 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:33:20.578433 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574056 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:33:20.578433 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574058 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:33:20.578433 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574061 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:33:20.578433 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574063 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:33:20.578433 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574065 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:33:20.578433 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574068 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:33:20.578433 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574071 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:33:20.578433 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574073 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:33:20.578433 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574076 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:33:20.578433 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574078 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:33:20.578433 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574080 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:33:20.579034 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574083 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:33:20.579034 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574085 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:33:20.579034 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574088 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:33:20.579034 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574090 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:33:20.579034 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574093 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:33:20.579034 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574095 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:33:20.579034 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574098 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:33:20.579034 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574100 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:33:20.579034 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574103 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:33:20.579034 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574107 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:33:20.579034 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574110 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:33:20.579034 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574113 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:33:20.579034 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574116 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:33:20.579034 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574119 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:33:20.579034 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574122 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:33:20.579392 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.574127 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 17:33:20.579392 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574239 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 17:33:20.579392 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574243 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 17:33:20.579392 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574246 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 17:33:20.579392 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574249 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 17:33:20.579392 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574251 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 17:33:20.579392 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574254 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 17:33:20.579392 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574256 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 17:33:20.579392 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574260 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 17:33:20.579392 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574264 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 17:33:20.579392 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574267 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 17:33:20.579392 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574269 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 17:33:20.579392 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574273 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 17:33:20.579392 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574276 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 17:33:20.579751 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574279 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 08 17:33:20.579751 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574281 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 17:33:20.579751 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574284 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 17:33:20.579751 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574287 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 17:33:20.579751 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574289 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 17:33:20.579751 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574292 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 17:33:20.579751 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574294 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 17:33:20.579751 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574298 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 17:33:20.579751 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574300 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 17:33:20.579751 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574303 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 17:33:20.579751 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574305 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 17:33:20.579751 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574308 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 17:33:20.579751 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574310 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 17:33:20.579751 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574313 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 17:33:20.579751 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574315 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 17:33:20.579751 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574318 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 17:33:20.579751 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574321 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 17:33:20.579751 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574323 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 17:33:20.579751 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574325 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 17:33:20.579751 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574328 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 17:33:20.580230 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574330 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 17:33:20.580230 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574333 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 17:33:20.580230 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574336 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 17:33:20.580230 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574339 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 17:33:20.580230 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574341 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 17:33:20.580230 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574344 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 17:33:20.580230 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574346 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 17:33:20.580230 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574349 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 17:33:20.580230 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574351 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 17:33:20.580230 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574354 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 17:33:20.580230 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574356 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 17:33:20.580230 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574358 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 17:33:20.580230 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574361 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 17:33:20.580230 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574363 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 17:33:20.580230 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574366 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 17:33:20.580230 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574368 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 17:33:20.580230 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574370 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 17:33:20.580230 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574373 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 17:33:20.580230 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574375 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 17:33:20.580704 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574378 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 17:33:20.580704 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574380 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 17:33:20.580704 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574383 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 17:33:20.580704 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574385 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 17:33:20.580704 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574387 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 17:33:20.580704 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574391 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 17:33:20.580704 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574393 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 17:33:20.580704 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574395 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 17:33:20.580704 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574398 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 17:33:20.580704 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574400 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 17:33:20.580704 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574403 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 17:33:20.580704 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574405 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 17:33:20.580704 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574407 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 17:33:20.580704 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574410 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 17:33:20.580704 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574412 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 17:33:20.580704 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574414 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 17:33:20.580704 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574417 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 17:33:20.580704 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574419 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 17:33:20.580704 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574421 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 17:33:20.580704 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574424 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 17:33:20.581178 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574426 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 17:33:20.581178 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574428 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 17:33:20.581178 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574431 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 17:33:20.581178 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574433 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 17:33:20.581178 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574436 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 17:33:20.581178 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574438 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 17:33:20.581178 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574440 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 17:33:20.581178 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574443 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 17:33:20.581178 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574445 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 17:33:20.581178 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574447 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 17:33:20.581178 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574450 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 17:33:20.581178 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574452 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 17:33:20.581178 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574455 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 17:33:20.581178 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574457 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 17:33:20.581178 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574460 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 17:33:20.581178 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574462 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 17:33:20.581178 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574465 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 17:33:20.581178 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574467 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 17:33:20.581178 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574470 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 17:33:20.581178 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574472 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 17:33:20.581716 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574474 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 17:33:20.581716 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574477 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 17:33:20.581716 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574480 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 17:33:20.581716 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574482 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 17:33:20.581716 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574484 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 17:33:20.581716 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574487 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 17:33:20.581716 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:20.574489 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 17:33:20.581716 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.574494 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 17:33:20.581716 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.574593 2552 server.go:962] "Client rotation is on, will bootstrap in background" Jul 08 17:33:20.581716 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.576747 2552 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 08 17:33:20.581716 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.578389 2552 server.go:1019] "Starting client certificate rotation" Jul 08 17:33:20.581716 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.578482 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 17:33:20.581716 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.579296 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 17:33:20.582191 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.582178 2552 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 17:33:20.586491 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.586469 2552 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 17:33:20.596400 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.596380 2552 log.go:25] "Validated CRI v1 runtime API" Jul 08 17:33:20.598940 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.598923 2552 log.go:25] "Validated CRI v1 image API" Jul 08 17:33:20.599802 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.599787 2552 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 08 17:33:20.604981 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.604954 2552 fs.go:135] Filesystem UUIDs: map[3048275d-4dfd-43ba-a787-9b6d728636cc:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c73a365c-2f95-4610-9eda-034504fd28d7:/dev/nvme0n1p3] Jul 08 17:33:20.605044 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.604980 2552 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 08 17:33:20.609165 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.609146 2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 17:33:20.609498 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.609393 2552 manager.go:216] Machine: {Timestamp:2026-07-08 17:33:20.60886297 +0000 UTC m=+0.372171401 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3110834 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b263fc6fd404bea6002e2096c638b SystemUUID:ec2b263f-c6fd-404b-ea60-02e2096c638b BootID:647d6ac7-3cff-4461-9d8b-6c3cf3259976 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:31:b5:57:b6:41 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:31:b5:57:b6:41 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:3f:64:a7:a2:d0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 08 17:33:20.609498 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.609497 2552 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 08 17:33:20.609601 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.609575 2552 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 08 17:33:20.613399 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.613362 2552 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 08 17:33:20.613555 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.613402 2552 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-38.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 08 17:33:20.614350 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.614340 2552 topology_manager.go:138] "Creating topology manager with none policy" Jul 08 17:33:20.614383 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.614353 2552 container_manager_linux.go:309] "Creating device plugin manager" Jul 08 17:33:20.614383 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.614361 2552 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 17:33:20.615249 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.615239 2552 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 17:33:20.616958 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.616948 2552 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 08 17:33:20.620154 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.620141 2552 state_mem.go:36] "Initialized new in-memory state store" Jul 08 17:33:20.620282 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.620272 2552 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 08 17:33:20.620321 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.620315 2552 kubelet.go:486] "Attempting to sync node with API server" Jul 08 17:33:20.620351 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.620325 2552 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 08 17:33:20.620351 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.620335 2552 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 08 17:33:20.620351 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.620344 2552 kubelet.go:398] "Adding apiserver pod source" Jul 08 17:33:20.620469 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.620353 2552 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 08 17:33:20.620766 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.620754 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 17:33:20.620811 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.620772 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 17:33:20.624321 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.624304 2552 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 08 17:33:20.626802 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.626786 2552 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 08 17:33:20.626859 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.626819 2552 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 08 17:33:20.628158 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.628144 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 08 17:33:20.628214 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.628165 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 08 17:33:20.628214 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.628172 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 08 17:33:20.628214 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.628179 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 08 17:33:20.628214 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.628189 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 08 17:33:20.628214 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.628196 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 08 17:33:20.628214 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.628204 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 08 17:33:20.628214 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.628210 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 08 17:33:20.628214 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.628216 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 08 17:33:20.628435 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.628221 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 08 17:33:20.628435 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.628230 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 08 17:33:20.628435 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.628235 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 08 17:33:20.629047 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.629035 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 08 17:33:20.629047 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.629045 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 08 17:33:20.632505 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.632489 2552 server.go:1268] "Started kubelet" Jul 08 17:33:20.636939 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.636802 2552 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 08 17:33:20.637032 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.632711 2552 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 08 17:33:20.637086 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.637049 2552 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 08 17:33:20.638249 ip-10-0-130-38 systemd[1]: Started Kubernetes Kubelet. Jul 08 17:33:20.639231 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:20.638578 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 08 17:33:20.639231 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:20.638746 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-38.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 08 17:33:20.639231 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.638382 2552 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-38.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 08 17:33:20.639231 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.639111 2552 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 08 17:33:20.642244 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.642229 2552 server.go:310] "Adding debug handlers to kubelet server" Jul 08 17:33:20.644412 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:20.644393 2552 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 08 17:33:20.645027 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:20.644012 2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-38.ec2.internal.18c060e7af3d4f2d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-38.ec2.internal,UID:ip-10-0-130-38.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-38.ec2.internal,},FirstTimestamp:2026-07-08 17:33:20.632459053 +0000 UTC m=+0.395767483,LastTimestamp:2026-07-08 17:33:20.632459053 +0000 UTC m=+0.395767483,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-38.ec2.internal,}" Jul 08 17:33:20.651804 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.651779 2552 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 08 17:33:20.651898 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.651809 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 08 17:33:20.651898 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:20.651889 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-38.ec2.internal\" not found" Jul 08 17:33:20.652546 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.652530 2552 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 08 17:33:20.652674 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.652661 2552 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 08 17:33:20.652774 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.652757 2552 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 08 17:33:20.652880 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.652665 2552 factory.go:55] Registering systemd factory Jul 08 17:33:20.652880 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.652810 2552 factory.go:223] Registration of the systemd container factory successfully Jul 08 17:33:20.652971 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.652883 2552 reconstruct.go:97] "Volume reconstruction finished" Jul 08 17:33:20.652971 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.652896 2552 reconciler.go:29] "Reconciler: start to sync state" Jul 08 17:33:20.653147 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.653127 2552 factory.go:153] Registering CRI-O factory Jul 08 17:33:20.653147 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.653143 2552 factory.go:223] Registration of the crio container factory successfully Jul 08 17:33:20.653284 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.653218 2552 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 08 17:33:20.653284 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.653242 2552 factory.go:103] Registering Raw factory Jul 08 17:33:20.653284 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.653256 2552 manager.go:1196] Started watching for new ooms in manager Jul 08 17:33:20.653883 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.653860 2552 manager.go:349] Starting recovery of all containers Jul 08 17:33:20.653883 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:20.653848 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 08 17:33:20.654040 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:20.653897 2552 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-38.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 08 17:33:20.663109 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.663094 2552 manager.go:354] Recovery completed Jul 08 17:33:20.663636 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.663602 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5mjzd" Jul 08 17:33:20.667675 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.667660 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:33:20.669380 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.669359 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-38.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:33:20.669448 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.669391 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-38.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:33:20.669448 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.669403 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-38.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:33:20.669905 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.669888 2552 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 08 17:33:20.669905 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.669903 2552 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 08 17:33:20.670032 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.669902 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:33:20.670032 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.669919 2552 state_mem.go:36] "Initialized new in-memory state store" Jul 08 17:33:20.670591 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.670576 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-38.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:33:20.670681 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.670603 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-38.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:33:20.670681 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.670614 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-38.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:33:20.671046 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.671035 2552 policy_none.go:49] "None policy: Start" Jul 08 17:33:20.671081 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.671049 2552 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 08 17:33:20.671081 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.671059 2552 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 08 17:33:20.671885 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.671875 2552 policy_none.go:47] "Start" Jul 08 17:33:20.672402 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.672290 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5mjzd" Jul 08 17:33:20.712063 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.712044 2552 manager.go:337] "Starting Device Plugin manager" Jul 08 17:33:20.712167 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:20.712080 2552 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 08 17:33:20.712167 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.712091 2552 server.go:87] "Starting device plugin registration server" Jul 08 17:33:20.712405 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.712390 2552 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 08 17:33:20.712457 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.712409 2552 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 08 17:33:20.712811 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.712610 2552 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 08 17:33:20.712811 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.712709 2552 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 08 17:33:20.712811 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.712720 2552 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 08 17:33:20.713486 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:20.713463 2552 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 08 17:33:20.713566 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:20.713520 2552 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-38.ec2.internal\" not found" Jul 08 17:33:20.771687 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.771648 2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 08 17:33:20.772957 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.772939 2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 08 17:33:20.773090 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.772975 2552 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 08 17:33:20.773090 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.772997 2552 kubelet.go:2448] "Starting kubelet main sync loop" Jul 08 17:33:20.773090 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:20.773029 2552 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 08 17:33:20.776276 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.776258 2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:33:20.813488 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.813411 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:33:20.814324 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.814304 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-38.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:33:20.814406 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.814339 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-38.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:33:20.814406 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.814357 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-38.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:33:20.814406 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.814382 2552 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-38.ec2.internal" Jul 08 17:33:20.823966 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.823950 2552 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-38.ec2.internal" Jul 08 17:33:20.824013 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:20.823971 2552 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-38.ec2.internal\": node \"ip-10-0-130-38.ec2.internal\" not found" Jul 08 17:33:20.861753 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:20.861727 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-38.ec2.internal\" not found" Jul 08 17:33:20.873335 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.873311 2552 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-38.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-38.ec2.internal"] Jul 08 17:33:20.873425 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.873388 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:33:20.874863 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.874847 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-38.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:33:20.874957 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.874879 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-38.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:33:20.874957 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.874894 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-38.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:33:20.876103 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.876087 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:33:20.876223 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.876208 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-38.ec2.internal" Jul 08 17:33:20.876269 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.876241 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:33:20.876863 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.876847 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-38.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:33:20.876935 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.876871 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-38.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:33:20.876935 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.876885 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-38.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:33:20.876935 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.876898 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-38.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:33:20.876935 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.876921 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-38.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:33:20.876935 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.876933 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-38.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:33:20.877920 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.877905 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-38.ec2.internal" Jul 08 17:33:20.877986 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.877935 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 17:33:20.878566 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.878551 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-38.ec2.internal" event="NodeHasSufficientMemory" Jul 08 17:33:20.878649 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.878581 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-38.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 17:33:20.878649 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.878594 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-38.ec2.internal" event="NodeHasSufficientPID" Jul 08 17:33:20.901191 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:20.901168 2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-38.ec2.internal\" not found" node="ip-10-0-130-38.ec2.internal" Jul 08 17:33:20.905605 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:20.905588 2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-38.ec2.internal\" not found" node="ip-10-0-130-38.ec2.internal" Jul 08 17:33:20.955193 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.955169 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/961de336e17a34d82a5c62043f886c07-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-38.ec2.internal\" (UID: \"961de336e17a34d82a5c62043f886c07\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-38.ec2.internal" Jul 08 17:33:20.955277 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.955201 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/961de336e17a34d82a5c62043f886c07-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-38.ec2.internal\" (UID: \"961de336e17a34d82a5c62043f886c07\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-38.ec2.internal" Jul 08 17:33:20.955277 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:20.955223 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f6230924fbe78dca7da4f87ec63109d6-config\") pod \"kube-apiserver-proxy-ip-10-0-130-38.ec2.internal\" (UID: \"f6230924fbe78dca7da4f87ec63109d6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-38.ec2.internal" Jul 08 17:33:20.961835 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:20.961816 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-38.ec2.internal\" not found" Jul 08 17:33:21.056159 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:21.056133 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/961de336e17a34d82a5c62043f886c07-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-38.ec2.internal\" (UID: \"961de336e17a34d82a5c62043f886c07\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-38.ec2.internal" Jul 08 17:33:21.056261 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:21.056168 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/961de336e17a34d82a5c62043f886c07-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-38.ec2.internal\" (UID: \"961de336e17a34d82a5c62043f886c07\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-38.ec2.internal" Jul 08 17:33:21.056261 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:21.056191 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f6230924fbe78dca7da4f87ec63109d6-config\") pod \"kube-apiserver-proxy-ip-10-0-130-38.ec2.internal\" (UID: \"f6230924fbe78dca7da4f87ec63109d6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-38.ec2.internal" Jul 08 17:33:21.056261 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:21.056249 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f6230924fbe78dca7da4f87ec63109d6-config\") pod \"kube-apiserver-proxy-ip-10-0-130-38.ec2.internal\" (UID: \"f6230924fbe78dca7da4f87ec63109d6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-38.ec2.internal" Jul 08 17:33:21.056368 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:21.056255 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/961de336e17a34d82a5c62043f886c07-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-38.ec2.internal\" (UID: \"961de336e17a34d82a5c62043f886c07\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-38.ec2.internal" Jul 08 17:33:21.056368 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:21.056249 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/961de336e17a34d82a5c62043f886c07-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-38.ec2.internal\" (UID: \"961de336e17a34d82a5c62043f886c07\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-38.ec2.internal" Jul 08 17:33:21.062245 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:21.062225 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-38.ec2.internal\" not found" Jul 08 17:33:21.163025 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:21.162950 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-38.ec2.internal\" not found" Jul 08 17:33:21.204139 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:21.204116 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-38.ec2.internal" Jul 08 17:33:21.208762 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:21.208747 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-38.ec2.internal" Jul 08 17:33:21.263192 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:21.263145 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-38.ec2.internal\" not found" Jul 08 17:33:21.363701 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:21.363678 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-38.ec2.internal\" not found" Jul 08 17:33:21.464231 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:21.464157 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-38.ec2.internal\" not found" Jul 08 17:33:21.564683 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:21.564655 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-38.ec2.internal\" not found" Jul 08 17:33:21.577818 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:21.577799 2552 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 08 17:33:21.577933 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:21.577917 2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 17:33:21.665143 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:21.665115 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-38.ec2.internal\" not found" Jul 08 17:33:21.674316 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:21.674263 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 17:28:22 +0000 UTC" deadline="2028-01-04 19:29:43.058413263 +0000 UTC" Jul 08 17:33:21.674316 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:21.674314 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13081h56m21.384103265s" Jul 08 17:33:21.765938 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:21.765869 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-38.ec2.internal\" not found" Jul 08 17:33:21.862042 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:21.861998 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod961de336e17a34d82a5c62043f886c07.slice/crio-9c97999b080deb573ce853db616d5aa6cad13eedd0f8421cfe0ed954da98cb3e WatchSource:0}: Error finding container 9c97999b080deb573ce853db616d5aa6cad13eedd0f8421cfe0ed954da98cb3e: Status 404 returned error can't find the container with id 9c97999b080deb573ce853db616d5aa6cad13eedd0f8421cfe0ed954da98cb3e Jul 08 17:33:21.862320 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:21.862299 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6230924fbe78dca7da4f87ec63109d6.slice/crio-48040117915d2c54f35d359e810081f7ca665e231bcae5155c9d2c74a0c4044c WatchSource:0}: Error finding container 48040117915d2c54f35d359e810081f7ca665e231bcae5155c9d2c74a0c4044c: Status 404 returned error can't find the container with id 48040117915d2c54f35d359e810081f7ca665e231bcae5155c9d2c74a0c4044c Jul 08 17:33:21.866146 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:21.866128 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-38.ec2.internal\" not found" Jul 08 17:33:21.867256 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:21.867242 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 17:33:21.875839 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:21.875824 2552 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:33:21.895723 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:21.895705 2552 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:33:21.952506 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:21.952468 2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-38.ec2.internal" Jul 08 17:33:21.966069 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:21.966051 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 17:33:21.967938 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:21.967924 2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-38.ec2.internal" Jul 08 17:33:21.974594 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:21.974580 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 17:33:22.231932 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:22.231858 2552 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:33:24.148782 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.148703 2552 apiserver.go:52] "Watching apiserver" Jul 08 17:33:24.158469 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.158436 2552 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 08 17:33:24.159866 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.159838 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-rrw9v","kube-system/global-pull-secret-syncer-6nt78","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d55d4","openshift-dns/node-resolver-xbmdk","openshift-image-registry/node-ca-jlll6","openshift-multus/network-metrics-daemon-xcp9j","openshift-ovn-kubernetes/ovnkube-node-nnnfl","kube-system/konnectivity-agent-hxmj2","kube-system/kube-apiserver-proxy-ip-10-0-130-38.ec2.internal","openshift-cluster-node-tuning-operator/tuned-dfl2q","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-38.ec2.internal","openshift-multus/multus-additional-cni-plugins-pvhnq","openshift-multus/multus-vqz52","openshift-network-diagnostics/network-check-target-xn2w6"] Jul 08 17:33:24.161715 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.161693 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.163177 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.163156 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.164263 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.164243 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d55d4" Jul 08 17:33:24.164913 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.164894 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 08 17:33:24.164913 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.164903 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 08 17:33:24.165119 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.165103 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 08 17:33:24.165183 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.165136 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 08 17:33:24.165242 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.165188 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 08 17:33:24.165242 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.165230 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-45dxr\"" Jul 08 17:33:24.165338 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.165270 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 08 17:33:24.165389 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.165274 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 08 17:33:24.165442 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.165406 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wf6zh\"" Jul 08 17:33:24.165723 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.165695 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xbmdk" Jul 08 17:33:24.165905 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.165873 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 08 17:33:24.166370 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.166351 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 08 17:33:24.166470 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.166391 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 08 17:33:24.166654 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.166637 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 08 17:33:24.166909 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.166890 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 08 17:33:24.167123 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.167100 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jlll6" Jul 08 17:33:24.167436 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.167414 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jmg7d\"" Jul 08 17:33:24.167604 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.167423 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 08 17:33:24.167744 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.167729 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 08 17:33:24.167982 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.167965 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 08 17:33:24.168312 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.168286 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-947gp\"" Jul 08 17:33:24.168652 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.168634 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcp9j" Jul 08 17:33:24.168754 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:24.168703 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcp9j" podUID="d359c83a-ba83-4914-85cc-d2b35b37759c" Jul 08 17:33:24.168969 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.168944 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 08 17:33:24.169842 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.169828 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xn2w6" Jul 08 17:33:24.170067 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.170046 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c8q8f\"" Jul 08 17:33:24.170160 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.170128 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 08 17:33:24.170343 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:24.170224 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xn2w6" podUID="78061d5b-da8f-4e57-aabe-71262ec1d1dd" Jul 08 17:33:24.170408 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.170350 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 08 17:33:24.171566 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.171034 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rrw9v" Jul 08 17:33:24.172255 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.172238 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nt78" Jul 08 17:33:24.172339 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:24.172295 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nt78" podUID="309592bc-ee3f-4203-a296-13edbb56a985" Jul 08 17:33:24.172991 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.172973 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:33:24.173323 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.173305 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 08 17:33:24.173509 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.173492 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-524kd\"" Jul 08 17:33:24.173723 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.173705 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 08 17:33:24.174394 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.174375 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.176778 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.176447 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 08 17:33:24.176778 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.176610 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:33:24.176778 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.176762 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6c8zq\"" Jul 08 17:33:24.176971 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.176890 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hxmj2" Jul 08 17:33:24.178061 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.178042 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pvhnq" Jul 08 17:33:24.179961 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.179869 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 08 17:33:24.181517 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.181500 2552 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 08 17:33:24.181784 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.181768 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 08 17:33:24.181980 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.181960 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zrspr\"" Jul 08 17:33:24.182169 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.182154 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 08 17:33:24.182375 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.182344 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-t5rbp\"" Jul 08 17:33:24.182499 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.182484 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 08 17:33:24.182700 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.182684 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 08 17:33:24.189277 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.188990 2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 17:33:24.193127 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193105 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f5dc768e-f2b0-417a-8405-4293201f4fe8-ovnkube-script-lib\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.193238 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193146 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pvhnq\" (UID: \"3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa\") " pod="openshift-multus/multus-additional-cni-plugins-pvhnq" Jul 08 17:33:24.193238 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193167 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfc4b46e-2008-40ce-b409-796fd7178d10-tmp-dir\") pod \"node-resolver-xbmdk\" (UID: \"dfc4b46e-2008-40ce-b409-796fd7178d10\") " pod="openshift-dns/node-resolver-xbmdk" Jul 08 17:33:24.193238 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193181 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5316994-1495-49ea-a279-808cb77f0f92-host\") pod \"node-ca-jlll6\" (UID: \"e5316994-1495-49ea-a279-808cb77f0f92\") " pod="openshift-image-registry/node-ca-jlll6" Jul 08 17:33:24.193238 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193194 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-log-socket\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.193238 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193215 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-systemd-units\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.193238 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193234 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f5dc768e-f2b0-417a-8405-4293201f4fe8-env-overrides\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.193617 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193248 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp2tn\" (UniqueName: \"kubernetes.io/projected/e3004f94-6d06-4493-8605-252aa6dd804e-kube-api-access-xp2tn\") pod \"aws-ebs-csi-driver-node-d55d4\" (UID: \"e3004f94-6d06-4493-8605-252aa6dd804e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d55d4" Jul 08 17:33:24.193617 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193264 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0091215-9d66-4287-b844-03cbee773abc-host\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.193617 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193276 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-run-systemd\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.193617 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193289 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-node-log\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.193617 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193308 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e3004f94-6d06-4493-8605-252aa6dd804e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d55d4\" (UID: \"e3004f94-6d06-4493-8605-252aa6dd804e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d55d4" Jul 08 17:33:24.193617 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193322 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e3004f94-6d06-4493-8605-252aa6dd804e-device-dir\") pod \"aws-ebs-csi-driver-node-d55d4\" (UID: \"e3004f94-6d06-4493-8605-252aa6dd804e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d55d4" Jul 08 17:33:24.193617 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193335 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc9ht\" (UniqueName: \"kubernetes.io/projected/3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa-kube-api-access-qc9ht\") pod \"multus-additional-cni-plugins-pvhnq\" (UID: \"3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa\") " pod="openshift-multus/multus-additional-cni-plugins-pvhnq" Jul 08 17:33:24.193617 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193349 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xhqc\" (UniqueName: \"kubernetes.io/projected/b0091215-9d66-4287-b844-03cbee773abc-kube-api-access-4xhqc\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.193617 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193363 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.193617 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193384 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e3004f94-6d06-4493-8605-252aa6dd804e-socket-dir\") pod \"aws-ebs-csi-driver-node-d55d4\" (UID: \"e3004f94-6d06-4493-8605-252aa6dd804e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d55d4" Jul 08 17:33:24.193617 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193399 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e3004f94-6d06-4493-8605-252aa6dd804e-registration-dir\") pod \"aws-ebs-csi-driver-node-d55d4\" (UID: \"e3004f94-6d06-4493-8605-252aa6dd804e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d55d4" Jul 08 17:33:24.193617 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193417 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/309592bc-ee3f-4203-a296-13edbb56a985-original-pull-secret\") pod \"global-pull-secret-syncer-6nt78\" (UID: \"309592bc-ee3f-4203-a296-13edbb56a985\") " pod="kube-system/global-pull-secret-syncer-6nt78" Jul 08 17:33:24.193617 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193438 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-os-release\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.193617 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193459 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0091215-9d66-4287-b844-03cbee773abc-sys\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.193617 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193494 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-host-run-netns\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.193617 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193512 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-host-var-lib-cni-multus\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.194381 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193527 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e5c2a1a7-7a93-41e1-8b66-5a7494b2366d-host-slash\") pod \"iptables-alerter-rrw9v\" (UID: \"e5c2a1a7-7a93-41e1-8b66-5a7494b2366d\") " pod="openshift-network-operator/iptables-alerter-rrw9v" Jul 08 17:33:24.194381 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193567 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b0091215-9d66-4287-b844-03cbee773abc-etc-sysconfig\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.194381 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193588 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0091215-9d66-4287-b844-03cbee773abc-var-lib-kubelet\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.194381 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193613 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-host-kubelet\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.194381 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193637 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-run-openvswitch\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.194381 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193669 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-host-run-ovn-kubernetes\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.194381 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193703 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-host-var-lib-cni-bin\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.194381 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193725 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-hostroot\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.194381 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193747 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b0091215-9d66-4287-b844-03cbee773abc-etc-sysctl-conf\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.194381 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193769 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d359c83a-ba83-4914-85cc-d2b35b37759c-metrics-certs\") pod \"network-metrics-daemon-xcp9j\" (UID: \"d359c83a-ba83-4914-85cc-d2b35b37759c\") " pod="openshift-multus/network-metrics-daemon-xcp9j" Jul 08 17:33:24.194381 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193792 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-pvhnq\" (UID: \"3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa\") " pod="openshift-multus/multus-additional-cni-plugins-pvhnq" Jul 08 17:33:24.194381 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193813 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-cnibin\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.194381 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193835 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-host-run-k8s-cni-cncf-io\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.194381 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193856 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksmws\" (UniqueName: \"kubernetes.io/projected/dfc4b46e-2008-40ce-b409-796fd7178d10-kube-api-access-ksmws\") pod \"node-resolver-xbmdk\" (UID: \"dfc4b46e-2008-40ce-b409-796fd7178d10\") " pod="openshift-dns/node-resolver-xbmdk" Jul 08 17:33:24.194381 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193880 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjnv9\" (UniqueName: \"kubernetes.io/projected/e5316994-1495-49ea-a279-808cb77f0f92-kube-api-access-wjnv9\") pod \"node-ca-jlll6\" (UID: \"e5316994-1495-49ea-a279-808cb77f0f92\") " pod="openshift-image-registry/node-ca-jlll6" Jul 08 17:33:24.194381 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193898 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8sx8\" (UniqueName: \"kubernetes.io/projected/e5c2a1a7-7a93-41e1-8b66-5a7494b2366d-kube-api-access-f8sx8\") pod \"iptables-alerter-rrw9v\" (UID: \"e5c2a1a7-7a93-41e1-8b66-5a7494b2366d\") " pod="openshift-network-operator/iptables-alerter-rrw9v" Jul 08 17:33:24.195024 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193911 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b0091215-9d66-4287-b844-03cbee773abc-run\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.195024 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193924 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-host-cni-bin\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.195024 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193944 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e3004f94-6d06-4493-8605-252aa6dd804e-etc-selinux\") pod \"aws-ebs-csi-driver-node-d55d4\" (UID: \"e3004f94-6d06-4493-8605-252aa6dd804e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d55d4" Jul 08 17:33:24.195024 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.193978 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xffv\" (UniqueName: \"kubernetes.io/projected/d359c83a-ba83-4914-85cc-d2b35b37759c-kube-api-access-9xffv\") pod \"network-metrics-daemon-xcp9j\" (UID: \"d359c83a-ba83-4914-85cc-d2b35b37759c\") " pod="openshift-multus/network-metrics-daemon-xcp9j" Jul 08 17:33:24.195024 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194006 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-etc-kubernetes\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.195024 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194021 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0091215-9d66-4287-b844-03cbee773abc-etc-kubernetes\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.195024 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194033 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0091215-9d66-4287-b844-03cbee773abc-lib-modules\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.195024 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194051 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b0091215-9d66-4287-b844-03cbee773abc-etc-tuned\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.195024 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194098 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-run-ovn\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.195024 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194127 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgphh\" (UniqueName: \"kubernetes.io/projected/f5dc768e-f2b0-417a-8405-4293201f4fe8-kube-api-access-lgphh\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.195024 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194174 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa-cnibin\") pod \"multus-additional-cni-plugins-pvhnq\" (UID: \"3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa\") " pod="openshift-multus/multus-additional-cni-plugins-pvhnq" Jul 08 17:33:24.195024 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194202 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-multus-conf-dir\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.195024 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194225 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/95c4a538-d097-4c50-8866-eb40d238ce32-multus-daemon-config\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.195024 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194261 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0091215-9d66-4287-b844-03cbee773abc-tmp\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.195024 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194290 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-host-slash\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.195024 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194314 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-multus-socket-dir-parent\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.195024 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194338 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e5316994-1495-49ea-a279-808cb77f0f92-serviceca\") pod \"node-ca-jlll6\" (UID: \"e5316994-1495-49ea-a279-808cb77f0f92\") " pod="openshift-image-registry/node-ca-jlll6" Jul 08 17:33:24.195571 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194365 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-system-cni-dir\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.195571 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194387 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95c4a538-d097-4c50-8866-eb40d238ce32-cni-binary-copy\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.195571 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194406 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-host-run-netns\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.195571 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194425 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-var-lib-openvswitch\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.195571 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194447 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e3004f94-6d06-4493-8605-252aa6dd804e-sys-fs\") pod \"aws-ebs-csi-driver-node-d55d4\" (UID: \"e3004f94-6d06-4493-8605-252aa6dd804e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d55d4" Jul 08 17:33:24.195571 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194467 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/309592bc-ee3f-4203-a296-13edbb56a985-kubelet-config\") pod \"global-pull-secret-syncer-6nt78\" (UID: \"309592bc-ee3f-4203-a296-13edbb56a985\") " pod="kube-system/global-pull-secret-syncer-6nt78" Jul 08 17:33:24.195571 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194487 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1480d4cf-8efd-4dab-8e04-4ac6f49efcdf-agent-certs\") pod \"konnectivity-agent-hxmj2\" (UID: \"1480d4cf-8efd-4dab-8e04-4ac6f49efcdf\") " pod="kube-system/konnectivity-agent-hxmj2" Jul 08 17:33:24.195571 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194506 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1480d4cf-8efd-4dab-8e04-4ac6f49efcdf-konnectivity-ca\") pod \"konnectivity-agent-hxmj2\" (UID: \"1480d4cf-8efd-4dab-8e04-4ac6f49efcdf\") " pod="kube-system/konnectivity-agent-hxmj2" Jul 08 17:33:24.195571 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194556 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pvhnq\" (UID: \"3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa\") " pod="openshift-multus/multus-additional-cni-plugins-pvhnq" Jul 08 17:33:24.195571 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194588 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-etc-openvswitch\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.195571 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194606 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa-system-cni-dir\") pod \"multus-additional-cni-plugins-pvhnq\" (UID: \"3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa\") " pod="openshift-multus/multus-additional-cni-plugins-pvhnq" Jul 08 17:33:24.195571 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194621 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dfc4b46e-2008-40ce-b409-796fd7178d10-hosts-file\") pod \"node-resolver-xbmdk\" (UID: \"dfc4b46e-2008-40ce-b409-796fd7178d10\") " pod="openshift-dns/node-resolver-xbmdk" Jul 08 17:33:24.195571 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194648 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b0091215-9d66-4287-b844-03cbee773abc-etc-modprobe-d\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.195571 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194668 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f5dc768e-f2b0-417a-8405-4293201f4fe8-ovn-node-metrics-cert\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.195571 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194698 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkl7r\" (UniqueName: \"kubernetes.io/projected/78061d5b-da8f-4e57-aabe-71262ec1d1dd-kube-api-access-jkl7r\") pod \"network-check-target-xn2w6\" (UID: \"78061d5b-da8f-4e57-aabe-71262ec1d1dd\") " pod="openshift-network-diagnostics/network-check-target-xn2w6" Jul 08 17:33:24.195571 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194726 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-host-run-multus-certs\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.196320 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194750 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7gfh\" (UniqueName: \"kubernetes.io/projected/95c4a538-d097-4c50-8866-eb40d238ce32-kube-api-access-j7gfh\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.196320 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194772 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b0091215-9d66-4287-b844-03cbee773abc-etc-systemd\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.196320 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194795 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-host-cni-netd\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.196320 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194819 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pvhnq\" (UID: \"3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa\") " pod="openshift-multus/multus-additional-cni-plugins-pvhnq" Jul 08 17:33:24.196320 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194843 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-multus-cni-dir\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.196320 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194865 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-host-var-lib-kubelet\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.196320 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194894 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e5c2a1a7-7a93-41e1-8b66-5a7494b2366d-iptables-alerter-script\") pod \"iptables-alerter-rrw9v\" (UID: \"e5c2a1a7-7a93-41e1-8b66-5a7494b2366d\") " pod="openshift-network-operator/iptables-alerter-rrw9v" Jul 08 17:33:24.196320 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194911 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b0091215-9d66-4287-b844-03cbee773abc-etc-sysctl-d\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.196320 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194927 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/309592bc-ee3f-4203-a296-13edbb56a985-dbus\") pod \"global-pull-secret-syncer-6nt78\" (UID: \"309592bc-ee3f-4203-a296-13edbb56a985\") " pod="kube-system/global-pull-secret-syncer-6nt78" Jul 08 17:33:24.196320 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194949 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa-os-release\") pod \"multus-additional-cni-plugins-pvhnq\" (UID: \"3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa\") " pod="openshift-multus/multus-additional-cni-plugins-pvhnq" Jul 08 17:33:24.196320 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.194965 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f5dc768e-f2b0-417a-8405-4293201f4fe8-ovnkube-config\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.197802 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.197661 2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 17:33:24.295195 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.295161 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5316994-1495-49ea-a279-808cb77f0f92-host\") pod \"node-ca-jlll6\" (UID: \"e5316994-1495-49ea-a279-808cb77f0f92\") " pod="openshift-image-registry/node-ca-jlll6" Jul 08 17:33:24.295323 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.295206 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-log-socket\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.295323 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.295230 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-systemd-units\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.295323 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.295252 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f5dc768e-f2b0-417a-8405-4293201f4fe8-env-overrides\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.295323 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.295275 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp2tn\" (UniqueName: \"kubernetes.io/projected/e3004f94-6d06-4493-8605-252aa6dd804e-kube-api-access-xp2tn\") pod \"aws-ebs-csi-driver-node-d55d4\" (UID: \"e3004f94-6d06-4493-8605-252aa6dd804e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d55d4" Jul 08 17:33:24.295457 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.295336 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-log-socket\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.295457 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.295382 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0091215-9d66-4287-b844-03cbee773abc-host\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.295457 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.295422 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-run-systemd\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.295457 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.295445 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-node-log\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.295610 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.295468 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e3004f94-6d06-4493-8605-252aa6dd804e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d55d4\" (UID: \"e3004f94-6d06-4493-8605-252aa6dd804e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d55d4" Jul 08 17:33:24.295610 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.295491 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e3004f94-6d06-4493-8605-252aa6dd804e-device-dir\") pod \"aws-ebs-csi-driver-node-d55d4\" (UID: \"e3004f94-6d06-4493-8605-252aa6dd804e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d55d4" Jul 08 17:33:24.295610 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.295517 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc9ht\" (UniqueName: \"kubernetes.io/projected/3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa-kube-api-access-qc9ht\") pod \"multus-additional-cni-plugins-pvhnq\" (UID: \"3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa\") " pod="openshift-multus/multus-additional-cni-plugins-pvhnq" Jul 08 17:33:24.295610 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.295560 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xhqc\" (UniqueName: \"kubernetes.io/projected/b0091215-9d66-4287-b844-03cbee773abc-kube-api-access-4xhqc\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.295610 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.295574 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-systemd-units\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.295610 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.295585 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.295776 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.295611 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e3004f94-6d06-4493-8605-252aa6dd804e-socket-dir\") pod \"aws-ebs-csi-driver-node-d55d4\" (UID: \"e3004f94-6d06-4493-8605-252aa6dd804e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d55d4" Jul 08 17:33:24.295776 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.295634 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e3004f94-6d06-4493-8605-252aa6dd804e-registration-dir\") pod \"aws-ebs-csi-driver-node-d55d4\" (UID: \"e3004f94-6d06-4493-8605-252aa6dd804e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d55d4" Jul 08 17:33:24.295776 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.295658 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/309592bc-ee3f-4203-a296-13edbb56a985-original-pull-secret\") pod \"global-pull-secret-syncer-6nt78\" (UID: \"309592bc-ee3f-4203-a296-13edbb56a985\") " pod="kube-system/global-pull-secret-syncer-6nt78" Jul 08 17:33:24.295776 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.295680 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-os-release\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.295776 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.295695 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0091215-9d66-4287-b844-03cbee773abc-sys\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.295776 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.295710 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-host-run-netns\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.295776 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.295717 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e3004f94-6d06-4493-8605-252aa6dd804e-device-dir\") pod \"aws-ebs-csi-driver-node-d55d4\" (UID: \"e3004f94-6d06-4493-8605-252aa6dd804e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d55d4" Jul 08 17:33:24.295776 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.295763 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-host-var-lib-cni-multus\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.295993 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.295920 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.296025 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296015 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e3004f94-6d06-4493-8605-252aa6dd804e-socket-dir\") pod \"aws-ebs-csi-driver-node-d55d4\" (UID: \"e3004f94-6d06-4493-8605-252aa6dd804e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d55d4" Jul 08 17:33:24.296057 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296009 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e5316994-1495-49ea-a279-808cb77f0f92-host\") pod \"node-ca-jlll6\" (UID: \"e5316994-1495-49ea-a279-808cb77f0f92\") " pod="openshift-image-registry/node-ca-jlll6" Jul 08 17:33:24.296057 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296050 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e3004f94-6d06-4493-8605-252aa6dd804e-registration-dir\") pod \"aws-ebs-csi-driver-node-d55d4\" (UID: \"e3004f94-6d06-4493-8605-252aa6dd804e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d55d4" Jul 08 17:33:24.296114 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296076 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b0091215-9d66-4287-b844-03cbee773abc-host\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.296146 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:24.296113 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:33:24.296146 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296115 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-run-systemd\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.296203 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296148 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e3004f94-6d06-4493-8605-252aa6dd804e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d55d4\" (UID: \"e3004f94-6d06-4493-8605-252aa6dd804e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d55d4" Jul 08 17:33:24.296203 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.295725 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-host-var-lib-cni-multus\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.296203 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296077 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f5dc768e-f2b0-417a-8405-4293201f4fe8-env-overrides\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.296203 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296170 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b0091215-9d66-4287-b844-03cbee773abc-sys\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.296203 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296113 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-node-log\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.296203 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:24.296168 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/309592bc-ee3f-4203-a296-13edbb56a985-original-pull-secret podName:309592bc-ee3f-4203-a296-13edbb56a985 nodeName:}" failed. No retries permitted until 2026-07-08 17:33:24.796154204 +0000 UTC m=+3.032546467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/309592bc-ee3f-4203-a296-13edbb56a985-original-pull-secret") pod "global-pull-secret-syncer-6nt78" (UID: "309592bc-ee3f-4203-a296-13edbb56a985") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:33:24.296389 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296205 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-host-run-netns\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.296389 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296253 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e5c2a1a7-7a93-41e1-8b66-5a7494b2366d-host-slash\") pod \"iptables-alerter-rrw9v\" (UID: \"e5c2a1a7-7a93-41e1-8b66-5a7494b2366d\") " pod="openshift-network-operator/iptables-alerter-rrw9v" Jul 08 17:33:24.296389 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296279 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b0091215-9d66-4287-b844-03cbee773abc-etc-sysconfig\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.296389 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296277 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-os-release\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.296389 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296304 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0091215-9d66-4287-b844-03cbee773abc-var-lib-kubelet\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.296389 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296325 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e5c2a1a7-7a93-41e1-8b66-5a7494b2366d-host-slash\") pod \"iptables-alerter-rrw9v\" (UID: \"e5c2a1a7-7a93-41e1-8b66-5a7494b2366d\") " pod="openshift-network-operator/iptables-alerter-rrw9v" Jul 08 17:33:24.296389 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296330 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-host-kubelet\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.296389 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296356 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0091215-9d66-4287-b844-03cbee773abc-var-lib-kubelet\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.296389 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296384 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-run-openvswitch\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.296752 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296354 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-run-openvswitch\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.296752 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296420 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-host-run-ovn-kubernetes\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.296752 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296332 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b0091215-9d66-4287-b844-03cbee773abc-etc-sysconfig\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.296752 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296429 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-host-kubelet\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.296752 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296458 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-host-run-ovn-kubernetes\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.296752 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296456 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-host-var-lib-cni-bin\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.296752 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296491 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-host-var-lib-cni-bin\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.296752 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296497 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-hostroot\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.296752 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296517 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b0091215-9d66-4287-b844-03cbee773abc-etc-sysctl-conf\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.296752 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296533 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d359c83a-ba83-4914-85cc-d2b35b37759c-metrics-certs\") pod \"network-metrics-daemon-xcp9j\" (UID: \"d359c83a-ba83-4914-85cc-d2b35b37759c\") " pod="openshift-multus/network-metrics-daemon-xcp9j" Jul 08 17:33:24.296752 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296558 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-hostroot\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.296752 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296574 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-pvhnq\" (UID: \"3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa\") " pod="openshift-multus/multus-additional-cni-plugins-pvhnq" Jul 08 17:33:24.296752 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296591 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-cnibin\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.296752 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296605 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-host-run-k8s-cni-cncf-io\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.296752 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296626 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksmws\" (UniqueName: \"kubernetes.io/projected/dfc4b46e-2008-40ce-b409-796fd7178d10-kube-api-access-ksmws\") pod \"node-resolver-xbmdk\" (UID: \"dfc4b46e-2008-40ce-b409-796fd7178d10\") " pod="openshift-dns/node-resolver-xbmdk" Jul 08 17:33:24.296752 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296644 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjnv9\" (UniqueName: \"kubernetes.io/projected/e5316994-1495-49ea-a279-808cb77f0f92-kube-api-access-wjnv9\") pod \"node-ca-jlll6\" (UID: \"e5316994-1495-49ea-a279-808cb77f0f92\") " pod="openshift-image-registry/node-ca-jlll6" Jul 08 17:33:24.296752 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296659 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8sx8\" (UniqueName: \"kubernetes.io/projected/e5c2a1a7-7a93-41e1-8b66-5a7494b2366d-kube-api-access-f8sx8\") pod \"iptables-alerter-rrw9v\" (UID: \"e5c2a1a7-7a93-41e1-8b66-5a7494b2366d\") " pod="openshift-network-operator/iptables-alerter-rrw9v" Jul 08 17:33:24.296752 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296674 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b0091215-9d66-4287-b844-03cbee773abc-run\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.297362 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296688 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-host-cni-bin\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.297362 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296703 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e3004f94-6d06-4493-8605-252aa6dd804e-etc-selinux\") pod \"aws-ebs-csi-driver-node-d55d4\" (UID: \"e3004f94-6d06-4493-8605-252aa6dd804e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d55d4" Jul 08 17:33:24.297362 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296707 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b0091215-9d66-4287-b844-03cbee773abc-etc-sysctl-conf\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.297362 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296722 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xffv\" (UniqueName: \"kubernetes.io/projected/d359c83a-ba83-4914-85cc-d2b35b37759c-kube-api-access-9xffv\") pod \"network-metrics-daemon-xcp9j\" (UID: \"d359c83a-ba83-4914-85cc-d2b35b37759c\") " pod="openshift-multus/network-metrics-daemon-xcp9j" Jul 08 17:33:24.297362 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296737 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-etc-kubernetes\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.297362 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296752 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0091215-9d66-4287-b844-03cbee773abc-etc-kubernetes\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.297362 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296779 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0091215-9d66-4287-b844-03cbee773abc-lib-modules\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.297362 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296794 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b0091215-9d66-4287-b844-03cbee773abc-etc-tuned\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.297362 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296808 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-run-ovn\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.297362 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:24.296819 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:33:24.297362 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296824 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgphh\" (UniqueName: \"kubernetes.io/projected/f5dc768e-f2b0-417a-8405-4293201f4fe8-kube-api-access-lgphh\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.297362 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296845 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa-cnibin\") pod \"multus-additional-cni-plugins-pvhnq\" (UID: \"3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa\") " pod="openshift-multus/multus-additional-cni-plugins-pvhnq" Jul 08 17:33:24.297362 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:24.296863 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d359c83a-ba83-4914-85cc-d2b35b37759c-metrics-certs podName:d359c83a-ba83-4914-85cc-d2b35b37759c nodeName:}" failed. No retries permitted until 2026-07-08 17:33:24.796849357 +0000 UTC m=+3.033241593 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d359c83a-ba83-4914-85cc-d2b35b37759c-metrics-certs") pod "network-metrics-daemon-xcp9j" (UID: "d359c83a-ba83-4914-85cc-d2b35b37759c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:33:24.297362 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296870 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa-cnibin\") pod \"multus-additional-cni-plugins-pvhnq\" (UID: \"3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa\") " pod="openshift-multus/multus-additional-cni-plugins-pvhnq" Jul 08 17:33:24.297362 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296891 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-multus-conf-dir\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.297362 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296912 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/95c4a538-d097-4c50-8866-eb40d238ce32-multus-daemon-config\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.297362 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296926 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0091215-9d66-4287-b844-03cbee773abc-tmp\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.297973 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296940 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-host-slash\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.297973 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296955 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-multus-socket-dir-parent\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.297973 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296970 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e5316994-1495-49ea-a279-808cb77f0f92-serviceca\") pod \"node-ca-jlll6\" (UID: \"e5316994-1495-49ea-a279-808cb77f0f92\") " pod="openshift-image-registry/node-ca-jlll6" Jul 08 17:33:24.297973 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.296984 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-system-cni-dir\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.297973 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.297000 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95c4a538-d097-4c50-8866-eb40d238ce32-cni-binary-copy\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.297973 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.297040 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-host-run-netns\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.297973 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.297061 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-var-lib-openvswitch\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.297973 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.297078 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e3004f94-6d06-4493-8605-252aa6dd804e-sys-fs\") pod \"aws-ebs-csi-driver-node-d55d4\" (UID: \"e3004f94-6d06-4493-8605-252aa6dd804e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d55d4" Jul 08 17:33:24.297973 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.297099 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/309592bc-ee3f-4203-a296-13edbb56a985-kubelet-config\") pod \"global-pull-secret-syncer-6nt78\" (UID: \"309592bc-ee3f-4203-a296-13edbb56a985\") " pod="kube-system/global-pull-secret-syncer-6nt78" Jul 08 17:33:24.297973 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.297121 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1480d4cf-8efd-4dab-8e04-4ac6f49efcdf-agent-certs\") pod \"konnectivity-agent-hxmj2\" (UID: \"1480d4cf-8efd-4dab-8e04-4ac6f49efcdf\") " pod="kube-system/konnectivity-agent-hxmj2" Jul 08 17:33:24.297973 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.297143 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1480d4cf-8efd-4dab-8e04-4ac6f49efcdf-konnectivity-ca\") pod \"konnectivity-agent-hxmj2\" (UID: \"1480d4cf-8efd-4dab-8e04-4ac6f49efcdf\") " pod="kube-system/konnectivity-agent-hxmj2" Jul 08 17:33:24.297973 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.297168 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pvhnq\" (UID: \"3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa\") " pod="openshift-multus/multus-additional-cni-plugins-pvhnq" Jul 08 17:33:24.297973 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.297183 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-etc-openvswitch\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.297973 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.297198 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa-system-cni-dir\") pod \"multus-additional-cni-plugins-pvhnq\" (UID: \"3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa\") " pod="openshift-multus/multus-additional-cni-plugins-pvhnq" Jul 08 17:33:24.297973 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.297214 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dfc4b46e-2008-40ce-b409-796fd7178d10-hosts-file\") pod \"node-resolver-xbmdk\" (UID: \"dfc4b46e-2008-40ce-b409-796fd7178d10\") " pod="openshift-dns/node-resolver-xbmdk" Jul 08 17:33:24.297973 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.297234 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b0091215-9d66-4287-b844-03cbee773abc-etc-modprobe-d\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.297973 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.297255 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f5dc768e-f2b0-417a-8405-4293201f4fe8-ovn-node-metrics-cert\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.298496 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.297280 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkl7r\" (UniqueName: \"kubernetes.io/projected/78061d5b-da8f-4e57-aabe-71262ec1d1dd-kube-api-access-jkl7r\") pod \"network-check-target-xn2w6\" (UID: \"78061d5b-da8f-4e57-aabe-71262ec1d1dd\") " pod="openshift-network-diagnostics/network-check-target-xn2w6" Jul 08 17:33:24.298496 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.297305 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-host-run-multus-certs\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.298496 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.297330 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7gfh\" (UniqueName: \"kubernetes.io/projected/95c4a538-d097-4c50-8866-eb40d238ce32-kube-api-access-j7gfh\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.298496 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.297354 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b0091215-9d66-4287-b844-03cbee773abc-etc-systemd\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.298496 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.297378 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-host-cni-netd\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.298496 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.297403 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pvhnq\" (UID: \"3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa\") " pod="openshift-multus/multus-additional-cni-plugins-pvhnq" Jul 08 17:33:24.298496 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.297430 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-multus-cni-dir\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.298496 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.297463 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-host-var-lib-kubelet\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.298496 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.297490 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e5c2a1a7-7a93-41e1-8b66-5a7494b2366d-iptables-alerter-script\") pod \"iptables-alerter-rrw9v\" (UID: \"e5c2a1a7-7a93-41e1-8b66-5a7494b2366d\") " pod="openshift-network-operator/iptables-alerter-rrw9v" Jul 08 17:33:24.298496 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.297497 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95c4a538-d097-4c50-8866-eb40d238ce32-cni-binary-copy\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.298496 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.297515 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b0091215-9d66-4287-b844-03cbee773abc-etc-sysctl-d\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.298496 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.297565 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/309592bc-ee3f-4203-a296-13edbb56a985-dbus\") pod \"global-pull-secret-syncer-6nt78\" (UID: \"309592bc-ee3f-4203-a296-13edbb56a985\") " pod="kube-system/global-pull-secret-syncer-6nt78" Jul 08 17:33:24.298496 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.297590 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa-os-release\") pod \"multus-additional-cni-plugins-pvhnq\" (UID: \"3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa\") " pod="openshift-multus/multus-additional-cni-plugins-pvhnq" Jul 08 17:33:24.298496 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.297616 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f5dc768e-f2b0-417a-8405-4293201f4fe8-ovnkube-config\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.298496 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.297626 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e3004f94-6d06-4493-8605-252aa6dd804e-etc-selinux\") pod \"aws-ebs-csi-driver-node-d55d4\" (UID: \"e3004f94-6d06-4493-8605-252aa6dd804e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d55d4" Jul 08 17:33:24.298496 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.297643 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f5dc768e-f2b0-417a-8405-4293201f4fe8-ovnkube-script-lib\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.298496 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.297656 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b0091215-9d66-4287-b844-03cbee773abc-etc-sysctl-d\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.299022 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.297670 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pvhnq\" (UID: \"3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa\") " pod="openshift-multus/multus-additional-cni-plugins-pvhnq" Jul 08 17:33:24.299022 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.297498 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/309592bc-ee3f-4203-a296-13edbb56a985-kubelet-config\") pod \"global-pull-secret-syncer-6nt78\" (UID: \"309592bc-ee3f-4203-a296-13edbb56a985\") " pod="kube-system/global-pull-secret-syncer-6nt78" Jul 08 17:33:24.299022 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.297954 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-system-cni-dir\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.299022 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.297995 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-etc-kubernetes\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.299022 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.298026 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfc4b46e-2008-40ce-b409-796fd7178d10-tmp-dir\") pod \"node-resolver-xbmdk\" (UID: \"dfc4b46e-2008-40ce-b409-796fd7178d10\") " pod="openshift-dns/node-resolver-xbmdk" Jul 08 17:33:24.299022 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.298062 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-host-run-multus-certs\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.299022 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.298264 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b0091215-9d66-4287-b844-03cbee773abc-etc-systemd\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.299022 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.298302 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-host-cni-netd\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.299022 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.298321 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f5dc768e-f2b0-417a-8405-4293201f4fe8-ovnkube-script-lib\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.299022 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.298340 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dfc4b46e-2008-40ce-b409-796fd7178d10-tmp-dir\") pod \"node-resolver-xbmdk\" (UID: \"dfc4b46e-2008-40ce-b409-796fd7178d10\") " pod="openshift-dns/node-resolver-xbmdk" Jul 08 17:33:24.299022 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.298448 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pvhnq\" (UID: \"3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa\") " pod="openshift-multus/multus-additional-cni-plugins-pvhnq" Jul 08 17:33:24.299022 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.298486 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-run-ovn\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.299022 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.298518 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-var-lib-openvswitch\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.299022 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.298583 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e3004f94-6d06-4493-8605-252aa6dd804e-sys-fs\") pod \"aws-ebs-csi-driver-node-d55d4\" (UID: \"e3004f94-6d06-4493-8605-252aa6dd804e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d55d4" Jul 08 17:33:24.299022 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.298898 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f5dc768e-f2b0-417a-8405-4293201f4fe8-ovnkube-config\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.299022 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.298962 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pvhnq\" (UID: \"3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa\") " pod="openshift-multus/multus-additional-cni-plugins-pvhnq" Jul 08 17:33:24.299441 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.299179 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-host-run-netns\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.299441 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.299240 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa-os-release\") pod \"multus-additional-cni-plugins-pvhnq\" (UID: \"3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa\") " pod="openshift-multus/multus-additional-cni-plugins-pvhnq" Jul 08 17:33:24.299441 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.299339 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b0091215-9d66-4287-b844-03cbee773abc-lib-modules\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.299441 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.299373 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-host-var-lib-kubelet\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.299441 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.299380 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa-cni-binary-copy\") pod \"multus-additional-cni-plugins-pvhnq\" (UID: \"3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa\") " pod="openshift-multus/multus-additional-cni-plugins-pvhnq" Jul 08 17:33:24.299441 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.299380 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1480d4cf-8efd-4dab-8e04-4ac6f49efcdf-konnectivity-ca\") pod \"konnectivity-agent-hxmj2\" (UID: \"1480d4cf-8efd-4dab-8e04-4ac6f49efcdf\") " pod="kube-system/konnectivity-agent-hxmj2" Jul 08 17:33:24.299702 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.299673 2552 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 08 17:33:24.299849 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.299830 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pvhnq\" (UID: \"3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa\") " pod="openshift-multus/multus-additional-cni-plugins-pvhnq" Jul 08 17:33:24.299908 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.299871 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e5c2a1a7-7a93-41e1-8b66-5a7494b2366d-iptables-alerter-script\") pod \"iptables-alerter-rrw9v\" (UID: \"e5c2a1a7-7a93-41e1-8b66-5a7494b2366d\") " pod="openshift-network-operator/iptables-alerter-rrw9v" Jul 08 17:33:24.299908 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.299892 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-cnibin\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.300066 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.299928 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-host-run-k8s-cni-cncf-io\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.300066 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.299954 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-etc-openvswitch\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.300066 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.299985 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa-system-cni-dir\") pod \"multus-additional-cni-plugins-pvhnq\" (UID: \"3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa\") " pod="openshift-multus/multus-additional-cni-plugins-pvhnq" Jul 08 17:33:24.300066 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.299997 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/309592bc-ee3f-4203-a296-13edbb56a985-dbus\") pod \"global-pull-secret-syncer-6nt78\" (UID: \"309592bc-ee3f-4203-a296-13edbb56a985\") " pod="kube-system/global-pull-secret-syncer-6nt78" Jul 08 17:33:24.300066 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.300012 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-multus-conf-dir\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.300459 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.300441 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/95c4a538-d097-4c50-8866-eb40d238ce32-multus-daemon-config\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.300525 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.300498 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dfc4b46e-2008-40ce-b409-796fd7178d10-hosts-file\") pod \"node-resolver-xbmdk\" (UID: \"dfc4b46e-2008-40ce-b409-796fd7178d10\") " pod="openshift-dns/node-resolver-xbmdk" Jul 08 17:33:24.300613 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.300596 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b0091215-9d66-4287-b844-03cbee773abc-etc-modprobe-d\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.300664 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.300595 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0091215-9d66-4287-b844-03cbee773abc-etc-kubernetes\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.300664 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.300625 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-host-cni-bin\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.301261 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.301195 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b0091215-9d66-4287-b844-03cbee773abc-run\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.301874 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.301849 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-multus-cni-dir\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.302262 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.302245 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e5316994-1495-49ea-a279-808cb77f0f92-serviceca\") pod \"node-ca-jlll6\" (UID: \"e5316994-1495-49ea-a279-808cb77f0f92\") " pod="openshift-image-registry/node-ca-jlll6" Jul 08 17:33:24.302362 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.302299 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/95c4a538-d097-4c50-8866-eb40d238ce32-multus-socket-dir-parent\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.302362 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.302335 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f5dc768e-f2b0-417a-8405-4293201f4fe8-host-slash\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.303453 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.303435 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0091215-9d66-4287-b844-03cbee773abc-tmp\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.303816 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.303795 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b0091215-9d66-4287-b844-03cbee773abc-etc-tuned\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.305045 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.305025 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6lqhh" Jul 08 17:33:24.317411 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.317388 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f5dc768e-f2b0-417a-8405-4293201f4fe8-ovn-node-metrics-cert\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.318348 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.317978 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xhqc\" (UniqueName: \"kubernetes.io/projected/b0091215-9d66-4287-b844-03cbee773abc-kube-api-access-4xhqc\") pod \"tuned-dfl2q\" (UID: \"b0091215-9d66-4287-b844-03cbee773abc\") " pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.318348 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.317980 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1480d4cf-8efd-4dab-8e04-4ac6f49efcdf-agent-certs\") pod \"konnectivity-agent-hxmj2\" (UID: \"1480d4cf-8efd-4dab-8e04-4ac6f49efcdf\") " pod="kube-system/konnectivity-agent-hxmj2" Jul 08 17:33:24.318552 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.318515 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6lqhh" Jul 08 17:33:24.321267 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.321244 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksmws\" (UniqueName: \"kubernetes.io/projected/dfc4b46e-2008-40ce-b409-796fd7178d10-kube-api-access-ksmws\") pod \"node-resolver-xbmdk\" (UID: \"dfc4b46e-2008-40ce-b409-796fd7178d10\") " pod="openshift-dns/node-resolver-xbmdk" Jul 08 17:33:24.321426 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:24.321411 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:33:24.321474 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:24.321431 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:33:24.321474 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:24.321440 2552 projected.go:196] Error preparing data for projected volume kube-api-access-jkl7r for pod openshift-network-diagnostics/network-check-target-xn2w6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:33:24.321474 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.321435 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc9ht\" (UniqueName: \"kubernetes.io/projected/3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa-kube-api-access-qc9ht\") pod \"multus-additional-cni-plugins-pvhnq\" (UID: \"3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa\") " pod="openshift-multus/multus-additional-cni-plugins-pvhnq" Jul 08 17:33:24.321605 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:24.321495 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78061d5b-da8f-4e57-aabe-71262ec1d1dd-kube-api-access-jkl7r podName:78061d5b-da8f-4e57-aabe-71262ec1d1dd nodeName:}" failed. No retries permitted until 2026-07-08 17:33:24.821482591 +0000 UTC m=+3.057874822 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jkl7r" (UniqueName: "kubernetes.io/projected/78061d5b-da8f-4e57-aabe-71262ec1d1dd-kube-api-access-jkl7r") pod "network-check-target-xn2w6" (UID: "78061d5b-da8f-4e57-aabe-71262ec1d1dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:33:24.321739 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.321690 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgphh\" (UniqueName: \"kubernetes.io/projected/f5dc768e-f2b0-417a-8405-4293201f4fe8-kube-api-access-lgphh\") pod \"ovnkube-node-nnnfl\" (UID: \"f5dc768e-f2b0-417a-8405-4293201f4fe8\") " pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.322098 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.322080 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xffv\" (UniqueName: \"kubernetes.io/projected/d359c83a-ba83-4914-85cc-d2b35b37759c-kube-api-access-9xffv\") pod \"network-metrics-daemon-xcp9j\" (UID: \"d359c83a-ba83-4914-85cc-d2b35b37759c\") " pod="openshift-multus/network-metrics-daemon-xcp9j" Jul 08 17:33:24.322143 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.322081 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp2tn\" (UniqueName: \"kubernetes.io/projected/e3004f94-6d06-4493-8605-252aa6dd804e-kube-api-access-xp2tn\") pod \"aws-ebs-csi-driver-node-d55d4\" (UID: \"e3004f94-6d06-4493-8605-252aa6dd804e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d55d4" Jul 08 17:33:24.322698 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.322426 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjnv9\" (UniqueName: \"kubernetes.io/projected/e5316994-1495-49ea-a279-808cb77f0f92-kube-api-access-wjnv9\") pod \"node-ca-jlll6\" (UID: \"e5316994-1495-49ea-a279-808cb77f0f92\") " pod="openshift-image-registry/node-ca-jlll6" Jul 08 17:33:24.322914 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.322894 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7gfh\" (UniqueName: \"kubernetes.io/projected/95c4a538-d097-4c50-8866-eb40d238ce32-kube-api-access-j7gfh\") pod \"multus-vqz52\" (UID: \"95c4a538-d097-4c50-8866-eb40d238ce32\") " pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.323799 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.323725 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-38.ec2.internal" event={"ID":"961de336e17a34d82a5c62043f886c07","Type":"ContainerStarted","Data":"9c97999b080deb573ce853db616d5aa6cad13eedd0f8421cfe0ed954da98cb3e"} Jul 08 17:33:24.324702 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.324682 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8sx8\" (UniqueName: \"kubernetes.io/projected/e5c2a1a7-7a93-41e1-8b66-5a7494b2366d-kube-api-access-f8sx8\") pod \"iptables-alerter-rrw9v\" (UID: \"e5c2a1a7-7a93-41e1-8b66-5a7494b2366d\") " pod="openshift-network-operator/iptables-alerter-rrw9v" Jul 08 17:33:24.325233 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.325055 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-38.ec2.internal" event={"ID":"f6230924fbe78dca7da4f87ec63109d6","Type":"ContainerStarted","Data":"48040117915d2c54f35d359e810081f7ca665e231bcae5155c9d2c74a0c4044c"} Jul 08 17:33:24.474585 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.474487 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:24.486738 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.486705 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vqz52" Jul 08 17:33:24.496633 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.496610 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d55d4" Jul 08 17:33:24.500390 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.500370 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xbmdk" Jul 08 17:33:24.508771 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.508727 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jlll6" Jul 08 17:33:24.517157 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.517136 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rrw9v" Jul 08 17:33:24.524703 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.524685 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" Jul 08 17:33:24.531191 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.531172 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hxmj2" Jul 08 17:33:24.536697 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.536677 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pvhnq" Jul 08 17:33:24.801147 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.801057 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/309592bc-ee3f-4203-a296-13edbb56a985-original-pull-secret\") pod \"global-pull-secret-syncer-6nt78\" (UID: \"309592bc-ee3f-4203-a296-13edbb56a985\") " pod="kube-system/global-pull-secret-syncer-6nt78" Jul 08 17:33:24.801147 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.801123 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d359c83a-ba83-4914-85cc-d2b35b37759c-metrics-certs\") pod \"network-metrics-daemon-xcp9j\" (UID: \"d359c83a-ba83-4914-85cc-d2b35b37759c\") " pod="openshift-multus/network-metrics-daemon-xcp9j" Jul 08 17:33:24.801358 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:24.801233 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:33:24.801358 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:24.801237 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:33:24.801358 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:24.801301 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d359c83a-ba83-4914-85cc-d2b35b37759c-metrics-certs podName:d359c83a-ba83-4914-85cc-d2b35b37759c nodeName:}" failed. No retries permitted until 2026-07-08 17:33:25.80128224 +0000 UTC m=+4.037674476 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d359c83a-ba83-4914-85cc-d2b35b37759c-metrics-certs") pod "network-metrics-daemon-xcp9j" (UID: "d359c83a-ba83-4914-85cc-d2b35b37759c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:33:24.801358 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:24.801318 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/309592bc-ee3f-4203-a296-13edbb56a985-original-pull-secret podName:309592bc-ee3f-4203-a296-13edbb56a985 nodeName:}" failed. No retries permitted until 2026-07-08 17:33:25.801311186 +0000 UTC m=+4.037703427 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/309592bc-ee3f-4203-a296-13edbb56a985-original-pull-secret") pod "global-pull-secret-syncer-6nt78" (UID: "309592bc-ee3f-4203-a296-13edbb56a985") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:33:24.902168 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:24.902135 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkl7r\" (UniqueName: \"kubernetes.io/projected/78061d5b-da8f-4e57-aabe-71262ec1d1dd-kube-api-access-jkl7r\") pod \"network-check-target-xn2w6\" (UID: \"78061d5b-da8f-4e57-aabe-71262ec1d1dd\") " pod="openshift-network-diagnostics/network-check-target-xn2w6" Jul 08 17:33:24.902323 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:24.902300 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:33:24.902323 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:24.902323 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:33:24.902449 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:24.902336 2552 projected.go:196] Error preparing data for projected volume kube-api-access-jkl7r for pod openshift-network-diagnostics/network-check-target-xn2w6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:33:24.902449 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:24.902418 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78061d5b-da8f-4e57-aabe-71262ec1d1dd-kube-api-access-jkl7r podName:78061d5b-da8f-4e57-aabe-71262ec1d1dd nodeName:}" failed. No retries permitted until 2026-07-08 17:33:25.902386608 +0000 UTC m=+4.138778855 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jkl7r" (UniqueName: "kubernetes.io/projected/78061d5b-da8f-4e57-aabe-71262ec1d1dd-kube-api-access-jkl7r") pod "network-check-target-xn2w6" (UID: "78061d5b-da8f-4e57-aabe-71262ec1d1dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:33:25.260227 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:25.260197 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1480d4cf_8efd_4dab_8e04_4ac6f49efcdf.slice/crio-204e2cbca3eb9d4e8447fda7b28f8dd08f2f63aedd5115f86c2e58019365f1f0 WatchSource:0}: Error finding container 204e2cbca3eb9d4e8447fda7b28f8dd08f2f63aedd5115f86c2e58019365f1f0: Status 404 returned error can't find the container with id 204e2cbca3eb9d4e8447fda7b28f8dd08f2f63aedd5115f86c2e58019365f1f0 Jul 08 17:33:25.261129 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:25.261108 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfc4b46e_2008_40ce_b409_796fd7178d10.slice/crio-ef9ef69399b740491fdfcc85b4d928ad89b94c3b7b8bf51feedf69a710fd8da0 WatchSource:0}: Error finding container ef9ef69399b740491fdfcc85b4d928ad89b94c3b7b8bf51feedf69a710fd8da0: Status 404 returned error can't find the container with id ef9ef69399b740491fdfcc85b4d928ad89b94c3b7b8bf51feedf69a710fd8da0 Jul 08 17:33:25.262838 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:25.262447 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0091215_9d66_4287_b844_03cbee773abc.slice/crio-b3c83c662016281588b5815e931c3f4f20335fd6b6f405a2884c38d0c359e558 WatchSource:0}: Error finding container b3c83c662016281588b5815e931c3f4f20335fd6b6f405a2884c38d0c359e558: Status 404 returned error can't find the container with id b3c83c662016281588b5815e931c3f4f20335fd6b6f405a2884c38d0c359e558 Jul 08 17:33:25.266401 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:25.265718 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95c4a538_d097_4c50_8866_eb40d238ce32.slice/crio-d88dfb3f4141924e1f5d0fa6d77050792cc7e50f1e780a836442e427c3b0341f WatchSource:0}: Error finding container d88dfb3f4141924e1f5d0fa6d77050792cc7e50f1e780a836442e427c3b0341f: Status 404 returned error can't find the container with id d88dfb3f4141924e1f5d0fa6d77050792cc7e50f1e780a836442e427c3b0341f Jul 08 17:33:25.268660 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:25.266966 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3004f94_6d06_4493_8605_252aa6dd804e.slice/crio-73eeb8b22481e5cdcff2a13acc0a43b6fcfc1d404f33d8f61459e14a171260df WatchSource:0}: Error finding container 73eeb8b22481e5cdcff2a13acc0a43b6fcfc1d404f33d8f61459e14a171260df: Status 404 returned error can't find the container with id 73eeb8b22481e5cdcff2a13acc0a43b6fcfc1d404f33d8f61459e14a171260df Jul 08 17:33:25.274357 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:25.274338 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5c2a1a7_7a93_41e1_8b66_5a7494b2366d.slice/crio-c3e9b4f3414cce5c85274ff4d7cd034fa3fad8f1cc1369e04a2ec78e9a350959 WatchSource:0}: Error finding container c3e9b4f3414cce5c85274ff4d7cd034fa3fad8f1cc1369e04a2ec78e9a350959: Status 404 returned error can't find the container with id c3e9b4f3414cce5c85274ff4d7cd034fa3fad8f1cc1369e04a2ec78e9a350959 Jul 08 17:33:25.323051 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:25.322918 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 17:28:24 +0000 UTC" deadline="2028-03-17 05:44:41.025453228 +0000 UTC" Jul 08 17:33:25.323051 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:25.323050 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14820h11m15.702406458s" Jul 08 17:33:25.328120 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:25.328097 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rrw9v" event={"ID":"e5c2a1a7-7a93-41e1-8b66-5a7494b2366d","Type":"ContainerStarted","Data":"c3e9b4f3414cce5c85274ff4d7cd034fa3fad8f1cc1369e04a2ec78e9a350959"} Jul 08 17:33:25.329164 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:25.329140 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d55d4" event={"ID":"e3004f94-6d06-4493-8605-252aa6dd804e","Type":"ContainerStarted","Data":"73eeb8b22481e5cdcff2a13acc0a43b6fcfc1d404f33d8f61459e14a171260df"} Jul 08 17:33:25.330068 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:25.330048 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" event={"ID":"f5dc768e-f2b0-417a-8405-4293201f4fe8","Type":"ContainerStarted","Data":"531a48218fdd0c35ab123601cb7cd66a26b206dc7d59e19323316bc4b3505772"} Jul 08 17:33:25.331415 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:25.331387 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" event={"ID":"b0091215-9d66-4287-b844-03cbee773abc","Type":"ContainerStarted","Data":"b3c83c662016281588b5815e931c3f4f20335fd6b6f405a2884c38d0c359e558"} Jul 08 17:33:25.332449 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:25.332427 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xbmdk" event={"ID":"dfc4b46e-2008-40ce-b409-796fd7178d10","Type":"ContainerStarted","Data":"ef9ef69399b740491fdfcc85b4d928ad89b94c3b7b8bf51feedf69a710fd8da0"} Jul 08 17:33:25.333290 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:25.333270 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hxmj2" event={"ID":"1480d4cf-8efd-4dab-8e04-4ac6f49efcdf","Type":"ContainerStarted","Data":"204e2cbca3eb9d4e8447fda7b28f8dd08f2f63aedd5115f86c2e58019365f1f0"} Jul 08 17:33:25.334470 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:25.334443 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jlll6" event={"ID":"e5316994-1495-49ea-a279-808cb77f0f92","Type":"ContainerStarted","Data":"04f3f62d59ab3311936b6ddd33c4b5cbce8223cd046d44922d35a32b649445cd"} Jul 08 17:33:25.335587 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:25.335562 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvhnq" event={"ID":"3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa","Type":"ContainerStarted","Data":"98d526522c563735d7118d780db26e566739c57fd0a00bb1b1a4c61b6e3a51f4"} Jul 08 17:33:25.336766 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:25.336744 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vqz52" event={"ID":"95c4a538-d097-4c50-8866-eb40d238ce32","Type":"ContainerStarted","Data":"d88dfb3f4141924e1f5d0fa6d77050792cc7e50f1e780a836442e427c3b0341f"} Jul 08 17:33:25.810088 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:25.808878 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/309592bc-ee3f-4203-a296-13edbb56a985-original-pull-secret\") pod \"global-pull-secret-syncer-6nt78\" (UID: \"309592bc-ee3f-4203-a296-13edbb56a985\") " pod="kube-system/global-pull-secret-syncer-6nt78" Jul 08 17:33:25.810088 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:25.808936 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d359c83a-ba83-4914-85cc-d2b35b37759c-metrics-certs\") pod \"network-metrics-daemon-xcp9j\" (UID: \"d359c83a-ba83-4914-85cc-d2b35b37759c\") " pod="openshift-multus/network-metrics-daemon-xcp9j" Jul 08 17:33:25.810088 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:25.809069 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:33:25.810088 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:25.809132 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d359c83a-ba83-4914-85cc-d2b35b37759c-metrics-certs podName:d359c83a-ba83-4914-85cc-d2b35b37759c nodeName:}" failed. No retries permitted until 2026-07-08 17:33:27.809112156 +0000 UTC m=+6.045504392 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d359c83a-ba83-4914-85cc-d2b35b37759c-metrics-certs") pod "network-metrics-daemon-xcp9j" (UID: "d359c83a-ba83-4914-85cc-d2b35b37759c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:33:25.810088 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:25.809576 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:33:25.810088 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:25.809671 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/309592bc-ee3f-4203-a296-13edbb56a985-original-pull-secret podName:309592bc-ee3f-4203-a296-13edbb56a985 nodeName:}" failed. No retries permitted until 2026-07-08 17:33:27.809654954 +0000 UTC m=+6.046047203 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/309592bc-ee3f-4203-a296-13edbb56a985-original-pull-secret") pod "global-pull-secret-syncer-6nt78" (UID: "309592bc-ee3f-4203-a296-13edbb56a985") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:33:25.910148 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:25.910108 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkl7r\" (UniqueName: \"kubernetes.io/projected/78061d5b-da8f-4e57-aabe-71262ec1d1dd-kube-api-access-jkl7r\") pod \"network-check-target-xn2w6\" (UID: \"78061d5b-da8f-4e57-aabe-71262ec1d1dd\") " pod="openshift-network-diagnostics/network-check-target-xn2w6" Jul 08 17:33:25.910377 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:25.910342 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:33:25.910377 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:25.910367 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:33:25.910483 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:25.910381 2552 projected.go:196] Error preparing data for projected volume kube-api-access-jkl7r for pod openshift-network-diagnostics/network-check-target-xn2w6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:33:25.910483 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:25.910441 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78061d5b-da8f-4e57-aabe-71262ec1d1dd-kube-api-access-jkl7r podName:78061d5b-da8f-4e57-aabe-71262ec1d1dd nodeName:}" failed. No retries permitted until 2026-07-08 17:33:27.910422405 +0000 UTC m=+6.146814653 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jkl7r" (UniqueName: "kubernetes.io/projected/78061d5b-da8f-4e57-aabe-71262ec1d1dd-kube-api-access-jkl7r") pod "network-check-target-xn2w6" (UID: "78061d5b-da8f-4e57-aabe-71262ec1d1dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:33:26.300779 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:26.300676 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nt78" Jul 08 17:33:26.301203 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:26.300810 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nt78" podUID="309592bc-ee3f-4203-a296-13edbb56a985" Jul 08 17:33:26.301265 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:26.301214 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcp9j" Jul 08 17:33:26.301351 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:26.301327 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcp9j" podUID="d359c83a-ba83-4914-85cc-d2b35b37759c" Jul 08 17:33:26.301414 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:26.301398 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xn2w6" Jul 08 17:33:26.301488 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:26.301468 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xn2w6" podUID="78061d5b-da8f-4e57-aabe-71262ec1d1dd" Jul 08 17:33:26.323865 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:26.323822 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 17:28:24 +0000 UTC" deadline="2028-04-01 19:55:04.810888098 +0000 UTC" Jul 08 17:33:26.323865 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:26.323866 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15194h21m38.487027536s" Jul 08 17:33:26.361633 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:26.361595 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-38.ec2.internal" event={"ID":"f6230924fbe78dca7da4f87ec63109d6","Type":"ContainerStarted","Data":"60d164d3c3070f4974b1b0140d3579498a02747b90ba26ad9c59053c4c422f51"} Jul 08 17:33:26.375305 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:26.374923 2552 generic.go:356] "Generic (PLEG): container finished" podID="961de336e17a34d82a5c62043f886c07" containerID="412c4d4caae0ac4b0c7bbf7257ea850a47b6158ba46dcc96aca3c70082edfa96" exitCode=0 Jul 08 17:33:26.375305 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:26.374961 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-38.ec2.internal" event={"ID":"961de336e17a34d82a5c62043f886c07","Type":"ContainerDied","Data":"412c4d4caae0ac4b0c7bbf7257ea850a47b6158ba46dcc96aca3c70082edfa96"} Jul 08 17:33:26.380897 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:26.380853 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-38.ec2.internal" podStartSLOduration=3.380835947 podStartE2EDuration="3.380835947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:33:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:33:26.380198904 +0000 UTC m=+4.616591158" watchObservedRunningTime="2026-07-08 17:33:26.380835947 +0000 UTC m=+4.617228201" Jul 08 17:33:27.391454 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:27.391414 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-38.ec2.internal" event={"ID":"961de336e17a34d82a5c62043f886c07","Type":"ContainerStarted","Data":"e470929de1c13ac2ce37502842c84f1b2975ca2ab9607d5de0bd35d188ce380a"} Jul 08 17:33:27.825369 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:27.825284 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/309592bc-ee3f-4203-a296-13edbb56a985-original-pull-secret\") pod \"global-pull-secret-syncer-6nt78\" (UID: \"309592bc-ee3f-4203-a296-13edbb56a985\") " pod="kube-system/global-pull-secret-syncer-6nt78" Jul 08 17:33:27.825369 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:27.825338 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d359c83a-ba83-4914-85cc-d2b35b37759c-metrics-certs\") pod \"network-metrics-daemon-xcp9j\" (UID: \"d359c83a-ba83-4914-85cc-d2b35b37759c\") " pod="openshift-multus/network-metrics-daemon-xcp9j" Jul 08 17:33:27.825659 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:27.825454 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:33:27.825659 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:27.825531 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/309592bc-ee3f-4203-a296-13edbb56a985-original-pull-secret podName:309592bc-ee3f-4203-a296-13edbb56a985 nodeName:}" failed. No retries permitted until 2026-07-08 17:33:31.825509303 +0000 UTC m=+10.061901540 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/309592bc-ee3f-4203-a296-13edbb56a985-original-pull-secret") pod "global-pull-secret-syncer-6nt78" (UID: "309592bc-ee3f-4203-a296-13edbb56a985") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:33:27.825888 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:27.825457 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:33:27.825957 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:27.825927 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d359c83a-ba83-4914-85cc-d2b35b37759c-metrics-certs podName:d359c83a-ba83-4914-85cc-d2b35b37759c nodeName:}" failed. No retries permitted until 2026-07-08 17:33:31.825911114 +0000 UTC m=+10.062303352 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d359c83a-ba83-4914-85cc-d2b35b37759c-metrics-certs") pod "network-metrics-daemon-xcp9j" (UID: "d359c83a-ba83-4914-85cc-d2b35b37759c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:33:27.926356 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:27.926318 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkl7r\" (UniqueName: \"kubernetes.io/projected/78061d5b-da8f-4e57-aabe-71262ec1d1dd-kube-api-access-jkl7r\") pod \"network-check-target-xn2w6\" (UID: \"78061d5b-da8f-4e57-aabe-71262ec1d1dd\") " pod="openshift-network-diagnostics/network-check-target-xn2w6" Jul 08 17:33:27.926589 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:27.926558 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:33:27.926589 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:27.926586 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:33:27.926718 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:27.926600 2552 projected.go:196] Error preparing data for projected volume kube-api-access-jkl7r for pod openshift-network-diagnostics/network-check-target-xn2w6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:33:27.926718 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:27.926657 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78061d5b-da8f-4e57-aabe-71262ec1d1dd-kube-api-access-jkl7r podName:78061d5b-da8f-4e57-aabe-71262ec1d1dd nodeName:}" failed. No retries permitted until 2026-07-08 17:33:31.926637888 +0000 UTC m=+10.163030122 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jkl7r" (UniqueName: "kubernetes.io/projected/78061d5b-da8f-4e57-aabe-71262ec1d1dd-kube-api-access-jkl7r") pod "network-check-target-xn2w6" (UID: "78061d5b-da8f-4e57-aabe-71262ec1d1dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:33:28.300607 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:28.300515 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nt78" Jul 08 17:33:28.300780 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:28.300662 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nt78" podUID="309592bc-ee3f-4203-a296-13edbb56a985" Jul 08 17:33:28.301049 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:28.301027 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcp9j" Jul 08 17:33:28.301168 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:28.301146 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcp9j" podUID="d359c83a-ba83-4914-85cc-d2b35b37759c" Jul 08 17:33:28.301213 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:28.301194 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xn2w6" Jul 08 17:33:28.301255 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:28.301237 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xn2w6" podUID="78061d5b-da8f-4e57-aabe-71262ec1d1dd" Jul 08 17:33:30.301220 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:30.301180 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nt78" Jul 08 17:33:30.301660 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:30.301318 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nt78" podUID="309592bc-ee3f-4203-a296-13edbb56a985" Jul 08 17:33:30.301761 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:30.301738 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcp9j" Jul 08 17:33:30.302302 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:30.301820 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcp9j" podUID="d359c83a-ba83-4914-85cc-d2b35b37759c" Jul 08 17:33:30.302302 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:30.301863 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xn2w6" Jul 08 17:33:30.302302 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:30.301902 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xn2w6" podUID="78061d5b-da8f-4e57-aabe-71262ec1d1dd" Jul 08 17:33:31.857859 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:31.857820 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/309592bc-ee3f-4203-a296-13edbb56a985-original-pull-secret\") pod \"global-pull-secret-syncer-6nt78\" (UID: \"309592bc-ee3f-4203-a296-13edbb56a985\") " pod="kube-system/global-pull-secret-syncer-6nt78" Jul 08 17:33:31.858266 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:31.857875 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d359c83a-ba83-4914-85cc-d2b35b37759c-metrics-certs\") pod \"network-metrics-daemon-xcp9j\" (UID: \"d359c83a-ba83-4914-85cc-d2b35b37759c\") " pod="openshift-multus/network-metrics-daemon-xcp9j" Jul 08 17:33:31.858266 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:31.858008 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:33:31.858266 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:31.858069 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d359c83a-ba83-4914-85cc-d2b35b37759c-metrics-certs podName:d359c83a-ba83-4914-85cc-d2b35b37759c nodeName:}" failed. No retries permitted until 2026-07-08 17:33:39.858050507 +0000 UTC m=+18.094442739 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d359c83a-ba83-4914-85cc-d2b35b37759c-metrics-certs") pod "network-metrics-daemon-xcp9j" (UID: "d359c83a-ba83-4914-85cc-d2b35b37759c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:33:31.858453 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:31.858438 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:33:31.858517 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:31.858486 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/309592bc-ee3f-4203-a296-13edbb56a985-original-pull-secret podName:309592bc-ee3f-4203-a296-13edbb56a985 nodeName:}" failed. No retries permitted until 2026-07-08 17:33:39.858472311 +0000 UTC m=+18.094864550 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/309592bc-ee3f-4203-a296-13edbb56a985-original-pull-secret") pod "global-pull-secret-syncer-6nt78" (UID: "309592bc-ee3f-4203-a296-13edbb56a985") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:33:31.958301 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:31.958261 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkl7r\" (UniqueName: \"kubernetes.io/projected/78061d5b-da8f-4e57-aabe-71262ec1d1dd-kube-api-access-jkl7r\") pod \"network-check-target-xn2w6\" (UID: \"78061d5b-da8f-4e57-aabe-71262ec1d1dd\") " pod="openshift-network-diagnostics/network-check-target-xn2w6" Jul 08 17:33:31.958492 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:31.958430 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:33:31.958492 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:31.958450 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:33:31.958492 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:31.958464 2552 projected.go:196] Error preparing data for projected volume kube-api-access-jkl7r for pod openshift-network-diagnostics/network-check-target-xn2w6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:33:31.958630 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:31.958520 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78061d5b-da8f-4e57-aabe-71262ec1d1dd-kube-api-access-jkl7r podName:78061d5b-da8f-4e57-aabe-71262ec1d1dd nodeName:}" failed. No retries permitted until 2026-07-08 17:33:39.958503163 +0000 UTC m=+18.194895416 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jkl7r" (UniqueName: "kubernetes.io/projected/78061d5b-da8f-4e57-aabe-71262ec1d1dd-kube-api-access-jkl7r") pod "network-check-target-xn2w6" (UID: "78061d5b-da8f-4e57-aabe-71262ec1d1dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:33:32.303385 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:32.303317 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcp9j" Jul 08 17:33:32.303550 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:32.303436 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcp9j" podUID="d359c83a-ba83-4914-85cc-d2b35b37759c" Jul 08 17:33:32.303661 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:32.303630 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nt78" Jul 08 17:33:32.303750 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:32.303730 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nt78" podUID="309592bc-ee3f-4203-a296-13edbb56a985" Jul 08 17:33:32.303832 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:32.303779 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xn2w6" Jul 08 17:33:32.303886 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:32.303839 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xn2w6" podUID="78061d5b-da8f-4e57-aabe-71262ec1d1dd" Jul 08 17:33:34.301234 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:34.300651 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcp9j" Jul 08 17:33:34.301234 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:34.300673 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xn2w6" Jul 08 17:33:34.301234 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:34.300787 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcp9j" podUID="d359c83a-ba83-4914-85cc-d2b35b37759c" Jul 08 17:33:34.301234 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:34.300827 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nt78" Jul 08 17:33:34.301234 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:34.300890 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xn2w6" podUID="78061d5b-da8f-4e57-aabe-71262ec1d1dd" Jul 08 17:33:34.301234 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:34.301130 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nt78" podUID="309592bc-ee3f-4203-a296-13edbb56a985" Jul 08 17:33:36.300574 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:36.300471 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nt78" Jul 08 17:33:36.301021 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:36.300473 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcp9j" Jul 08 17:33:36.301021 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:36.300623 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nt78" podUID="309592bc-ee3f-4203-a296-13edbb56a985" Jul 08 17:33:36.301021 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:36.300477 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xn2w6" Jul 08 17:33:36.301021 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:36.300712 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcp9j" podUID="d359c83a-ba83-4914-85cc-d2b35b37759c" Jul 08 17:33:36.301021 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:36.300802 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xn2w6" podUID="78061d5b-da8f-4e57-aabe-71262ec1d1dd" Jul 08 17:33:38.300722 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:38.300696 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcp9j" Jul 08 17:33:38.301144 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:38.300813 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcp9j" podUID="d359c83a-ba83-4914-85cc-d2b35b37759c" Jul 08 17:33:38.301193 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:38.301145 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xn2w6" Jul 08 17:33:38.301224 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:38.301210 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xn2w6" podUID="78061d5b-da8f-4e57-aabe-71262ec1d1dd" Jul 08 17:33:38.301257 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:38.301243 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nt78" Jul 08 17:33:38.301319 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:38.301302 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nt78" podUID="309592bc-ee3f-4203-a296-13edbb56a985" Jul 08 17:33:39.920301 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:39.920256 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/309592bc-ee3f-4203-a296-13edbb56a985-original-pull-secret\") pod \"global-pull-secret-syncer-6nt78\" (UID: \"309592bc-ee3f-4203-a296-13edbb56a985\") " pod="kube-system/global-pull-secret-syncer-6nt78" Jul 08 17:33:39.920908 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:39.920322 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d359c83a-ba83-4914-85cc-d2b35b37759c-metrics-certs\") pod \"network-metrics-daemon-xcp9j\" (UID: \"d359c83a-ba83-4914-85cc-d2b35b37759c\") " pod="openshift-multus/network-metrics-daemon-xcp9j" Jul 08 17:33:39.920908 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:39.920438 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:33:39.920908 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:39.920440 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:33:39.920908 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:39.920496 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d359c83a-ba83-4914-85cc-d2b35b37759c-metrics-certs podName:d359c83a-ba83-4914-85cc-d2b35b37759c nodeName:}" failed. No retries permitted until 2026-07-08 17:33:55.920478332 +0000 UTC m=+34.156870582 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d359c83a-ba83-4914-85cc-d2b35b37759c-metrics-certs") pod "network-metrics-daemon-xcp9j" (UID: "d359c83a-ba83-4914-85cc-d2b35b37759c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:33:39.920908 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:39.920513 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/309592bc-ee3f-4203-a296-13edbb56a985-original-pull-secret podName:309592bc-ee3f-4203-a296-13edbb56a985 nodeName:}" failed. No retries permitted until 2026-07-08 17:33:55.920506382 +0000 UTC m=+34.156898614 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/309592bc-ee3f-4203-a296-13edbb56a985-original-pull-secret") pod "global-pull-secret-syncer-6nt78" (UID: "309592bc-ee3f-4203-a296-13edbb56a985") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:33:40.021217 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:40.021181 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkl7r\" (UniqueName: \"kubernetes.io/projected/78061d5b-da8f-4e57-aabe-71262ec1d1dd-kube-api-access-jkl7r\") pod \"network-check-target-xn2w6\" (UID: \"78061d5b-da8f-4e57-aabe-71262ec1d1dd\") " pod="openshift-network-diagnostics/network-check-target-xn2w6" Jul 08 17:33:40.021374 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:40.021357 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:33:40.021426 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:40.021377 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:33:40.021426 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:40.021387 2552 projected.go:196] Error preparing data for projected volume kube-api-access-jkl7r for pod openshift-network-diagnostics/network-check-target-xn2w6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:33:40.021509 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:40.021445 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78061d5b-da8f-4e57-aabe-71262ec1d1dd-kube-api-access-jkl7r podName:78061d5b-da8f-4e57-aabe-71262ec1d1dd nodeName:}" failed. No retries permitted until 2026-07-08 17:33:56.021425994 +0000 UTC m=+34.257818234 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jkl7r" (UniqueName: "kubernetes.io/projected/78061d5b-da8f-4e57-aabe-71262ec1d1dd-kube-api-access-jkl7r") pod "network-check-target-xn2w6" (UID: "78061d5b-da8f-4e57-aabe-71262ec1d1dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:33:40.301069 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:40.300991 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcp9j" Jul 08 17:33:40.301069 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:40.301044 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nt78" Jul 08 17:33:40.301280 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:40.301067 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xn2w6" Jul 08 17:33:40.301280 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:40.301169 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nt78" podUID="309592bc-ee3f-4203-a296-13edbb56a985" Jul 08 17:33:40.301280 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:40.301214 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xn2w6" podUID="78061d5b-da8f-4e57-aabe-71262ec1d1dd" Jul 08 17:33:40.301280 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:40.301233 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcp9j" podUID="d359c83a-ba83-4914-85cc-d2b35b37759c" Jul 08 17:33:42.301872 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:42.301840 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcp9j" Jul 08 17:33:42.301872 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:42.301874 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xn2w6" Jul 08 17:33:42.302388 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:42.301964 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcp9j" podUID="d359c83a-ba83-4914-85cc-d2b35b37759c" Jul 08 17:33:42.302388 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:42.302018 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xn2w6" podUID="78061d5b-da8f-4e57-aabe-71262ec1d1dd" Jul 08 17:33:42.302388 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:42.302061 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nt78" Jul 08 17:33:42.302388 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:42.302128 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nt78" podUID="309592bc-ee3f-4203-a296-13edbb56a985" Jul 08 17:33:44.301348 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:44.301122 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nt78" Jul 08 17:33:44.301643 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:44.301470 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nt78" podUID="309592bc-ee3f-4203-a296-13edbb56a985" Jul 08 17:33:44.301643 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:44.301168 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xn2w6" Jul 08 17:33:44.301643 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:44.301601 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xn2w6" podUID="78061d5b-da8f-4e57-aabe-71262ec1d1dd" Jul 08 17:33:44.301643 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:44.301122 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcp9j" Jul 08 17:33:44.301765 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:44.301699 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcp9j" podUID="d359c83a-ba83-4914-85cc-d2b35b37759c" Jul 08 17:33:44.428242 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:44.428028 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d55d4" event={"ID":"e3004f94-6d06-4493-8605-252aa6dd804e","Type":"ContainerStarted","Data":"85f9b5f477cb02efc2a5721818fc62074a20446f900dce12282e0bff9e77bdee"} Jul 08 17:33:44.431119 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:44.431029 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" event={"ID":"f5dc768e-f2b0-417a-8405-4293201f4fe8","Type":"ContainerStarted","Data":"02cd2ce1d69f66adb466f2a508dd43a9c2841faceb670e7d7bdb0eb8a84c686d"} Jul 08 17:33:44.431119 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:44.431113 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" event={"ID":"f5dc768e-f2b0-417a-8405-4293201f4fe8","Type":"ContainerStarted","Data":"83a608d92bb06c267410f52690216314125887e7223a7ec00c5788c9c2362476"} Jul 08 17:33:44.433458 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:44.433431 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" event={"ID":"b0091215-9d66-4287-b844-03cbee773abc","Type":"ContainerStarted","Data":"e03d81ac4e42f14d1097bfd83a86a4e4ee3da8181b4064fd8a87ca2bd748362e"} Jul 08 17:33:44.435799 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:44.435672 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xbmdk" event={"ID":"dfc4b46e-2008-40ce-b409-796fd7178d10","Type":"ContainerStarted","Data":"d574413e61914523db7724e4b06dc541b78a2efe50bcd26f927301a93352528b"} Jul 08 17:33:44.439507 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:44.439482 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hxmj2" event={"ID":"1480d4cf-8efd-4dab-8e04-4ac6f49efcdf","Type":"ContainerStarted","Data":"a4bb3311a1811dc85b22e069fd145393cfe95d54b5f32bed657baab7298c32cf"} Jul 08 17:33:44.440986 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:44.440948 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jlll6" event={"ID":"e5316994-1495-49ea-a279-808cb77f0f92","Type":"ContainerStarted","Data":"c6279d707c8574c6df4e6830914c919ef0229abdcd69840673cab27395b6b6dc"} Jul 08 17:33:44.443206 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:44.443141 2552 generic.go:356] "Generic (PLEG): container finished" podID="3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa" containerID="2bf3e1150dc39b05da8dc9370929a59858ff4ba5ace5192f597c110f15908b95" exitCode=0 Jul 08 17:33:44.443206 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:44.443170 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvhnq" event={"ID":"3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa","Type":"ContainerDied","Data":"2bf3e1150dc39b05da8dc9370929a59858ff4ba5ace5192f597c110f15908b95"} Jul 08 17:33:44.444754 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:44.444721 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vqz52" event={"ID":"95c4a538-d097-4c50-8866-eb40d238ce32","Type":"ContainerStarted","Data":"92dc4ff93c095c8afdca93916e9da3032a9af89729b943975bb39ea01aa90a43"} Jul 08 17:33:44.461266 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:44.461225 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-38.ec2.internal" podStartSLOduration=21.461211366 podStartE2EDuration="21.461211366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:33:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:33:27.408666507 +0000 UTC m=+5.645058759" watchObservedRunningTime="2026-07-08 17:33:44.461211366 +0000 UTC m=+22.697603618" Jul 08 17:33:44.481673 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:44.481589 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xbmdk" podStartSLOduration=3.620010411 podStartE2EDuration="22.481568856s" totalImagesPullingTime="18.861558445s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:33:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:33:44.481504769 +0000 UTC m=+22.717897023" watchObservedRunningTime="2026-07-08 17:33:44.481568856 +0000 UTC m=+22.717961113" Jul 08 17:33:44.482242 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:44.482198 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dfl2q" podStartSLOduration=3.622805316 podStartE2EDuration="22.482184089s" totalImagesPullingTime="18.859378773s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:33:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:33:44.461765338 +0000 UTC m=+22.698157602" watchObservedRunningTime="2026-07-08 17:33:44.482184089 +0000 UTC m=+22.718576343" Jul 08 17:33:44.531879 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:44.531832 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hxmj2" podStartSLOduration=3.669470908 podStartE2EDuration="22.531816197s" totalImagesPullingTime="18.862345289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:33:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:33:44.50824036 +0000 UTC m=+22.744632612" watchObservedRunningTime="2026-07-08 17:33:44.531816197 +0000 UTC m=+22.768208451" Jul 08 17:33:44.551992 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:44.551531 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vqz52" podStartSLOduration=3.638040225 podStartE2EDuration="22.551509323s" totalImagesPullingTime="18.913469098s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:33:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:33:44.550755439 +0000 UTC m=+22.787147883" watchObservedRunningTime="2026-07-08 17:33:44.551509323 +0000 UTC m=+22.787901578" Jul 08 17:33:44.569350 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:44.569313 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jlll6" podStartSLOduration=3.713062558 podStartE2EDuration="22.5692992s" totalImagesPullingTime="18.856236642s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:33:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:33:44.569061562 +0000 UTC m=+22.805453814" watchObservedRunningTime="2026-07-08 17:33:44.5692992 +0000 UTC m=+22.805691452" Jul 08 17:33:44.577032 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:44.577015 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hxmj2" Jul 08 17:33:44.577611 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:44.577593 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hxmj2" Jul 08 17:33:45.453149 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:45.453122 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" event={"ID":"f5dc768e-f2b0-417a-8405-4293201f4fe8","Type":"ContainerStarted","Data":"69f2c9e9676cdddfe75fc54300cc30bc79e80a7a2309301aae130dbf646e79a8"} Jul 08 17:33:45.453855 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:45.453198 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" event={"ID":"f5dc768e-f2b0-417a-8405-4293201f4fe8","Type":"ContainerStarted","Data":"00759ee69ac092c3de3d4e4d5e6b091f91bd6ebecc15998e29d0be60312647fa"} Jul 08 17:33:45.453855 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:45.453234 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" event={"ID":"f5dc768e-f2b0-417a-8405-4293201f4fe8","Type":"ContainerStarted","Data":"04ef92ca02927bd0c2d3b64d1286682d26793b58568d00e84edfce855e3dd990"} Jul 08 17:33:45.453855 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:45.453272 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" event={"ID":"f5dc768e-f2b0-417a-8405-4293201f4fe8","Type":"ContainerStarted","Data":"4c222a624b050dd7998eea4c8fdef542cf919ec8295ef2bb2e8b11c4083def09"} Jul 08 17:33:45.453855 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:45.453670 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hxmj2" Jul 08 17:33:45.454127 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:45.454100 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hxmj2" Jul 08 17:33:46.302434 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:46.300446 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcp9j" Jul 08 17:33:46.302434 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:46.300615 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcp9j" podUID="d359c83a-ba83-4914-85cc-d2b35b37759c" Jul 08 17:33:46.302434 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:46.301007 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xn2w6" Jul 08 17:33:46.302434 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:46.301091 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xn2w6" podUID="78061d5b-da8f-4e57-aabe-71262ec1d1dd" Jul 08 17:33:46.302434 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:46.301237 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nt78" Jul 08 17:33:46.302434 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:46.301355 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nt78" podUID="309592bc-ee3f-4203-a296-13edbb56a985" Jul 08 17:33:46.356005 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:46.355983 2552 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 08 17:33:46.457042 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:46.457008 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rrw9v" event={"ID":"e5c2a1a7-7a93-41e1-8b66-5a7494b2366d","Type":"ContainerStarted","Data":"b4ce26f67185f7c62d05b889d92396e4e2bfd3dddf4932924bc3afcfb73beb67"} Jul 08 17:33:46.458807 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:46.458784 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d55d4" event={"ID":"e3004f94-6d06-4493-8605-252aa6dd804e","Type":"ContainerStarted","Data":"21c46f765397fb8318874a30db036ef22bcb57ba60a2f5172f0f3b751bf086f2"} Jul 08 17:33:46.471692 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:46.471653 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rrw9v" podStartSLOduration=5.620226689 podStartE2EDuration="24.471642222s" totalImagesPullingTime="18.851415533s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:33:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:33:46.471626805 +0000 UTC m=+24.708019059" watchObservedRunningTime="2026-07-08 17:33:46.471642222 +0000 UTC m=+24.708034475" Jul 08 17:33:47.255286 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:47.255162 2552 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T17:33:46.355999371Z","UUID":"00cebf40-d5aa-469a-8f30-956508c943d9","Handler":null,"Name":"","Endpoint":""} Jul 08 17:33:47.256614 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:47.256597 2552 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 08 17:33:47.256721 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:47.256631 2552 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 08 17:33:47.465368 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:47.465330 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" event={"ID":"f5dc768e-f2b0-417a-8405-4293201f4fe8","Type":"ContainerStarted","Data":"0663b89beab6a15c2890971c69ee68fdf1c6c23891ffcd7876415e2eb7065645"} Jul 08 17:33:48.300871 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:48.300691 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xn2w6" Jul 08 17:33:48.301043 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:48.300691 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcp9j" Jul 08 17:33:48.301043 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:48.300951 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xn2w6" podUID="78061d5b-da8f-4e57-aabe-71262ec1d1dd" Jul 08 17:33:48.301132 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:48.301067 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcp9j" podUID="d359c83a-ba83-4914-85cc-d2b35b37759c" Jul 08 17:33:48.301132 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:48.300707 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nt78" Jul 08 17:33:48.301221 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:48.301173 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nt78" podUID="309592bc-ee3f-4203-a296-13edbb56a985" Jul 08 17:33:49.472888 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:49.472799 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d55d4" event={"ID":"e3004f94-6d06-4493-8605-252aa6dd804e","Type":"ContainerStarted","Data":"d79210e536a39d0a32a773487472a32c007e054c777fdb37f40b798c8a6dee06"} Jul 08 17:33:49.479870 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:49.479707 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" event={"ID":"f5dc768e-f2b0-417a-8405-4293201f4fe8","Type":"ContainerStarted","Data":"8f969ea8670a7ba38950480231df50d3316597189eafab32c8b839c6d28f502d"} Jul 08 17:33:49.479870 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:49.479856 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:49.480163 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:49.480145 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:49.480240 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:49.480228 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:49.485100 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:49.484973 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvhnq" event={"ID":"3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa","Type":"ContainerStarted","Data":"81cb747113eaf80220b29d1b7246f676fc6c69cdffaba6552da6c08134b59491"} Jul 08 17:33:49.499965 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:49.499003 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:49.502463 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:49.501932 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:33:49.521751 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:49.521666 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d55d4" podStartSLOduration=3.787470639 podStartE2EDuration="27.521648646s" totalImagesPullingTime="23.734178007s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:33:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:33:49.493394318 +0000 UTC m=+27.729786574" watchObservedRunningTime="2026-07-08 17:33:49.521648646 +0000 UTC m=+27.758040899" Jul 08 17:33:49.551423 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:49.551382 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" podStartSLOduration=8.622449381 podStartE2EDuration="27.551367372s" totalImagesPullingTime="18.928917991s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:33:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:33:49.522194403 +0000 UTC m=+27.758586660" watchObservedRunningTime="2026-07-08 17:33:49.551367372 +0000 UTC m=+27.787759643" Jul 08 17:33:50.303776 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:50.303597 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcp9j" Jul 08 17:33:50.303920 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:50.303597 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nt78" Jul 08 17:33:50.303920 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:50.303847 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcp9j" podUID="d359c83a-ba83-4914-85cc-d2b35b37759c" Jul 08 17:33:50.303920 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:50.303597 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xn2w6" Jul 08 17:33:50.303920 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:50.303903 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nt78" podUID="309592bc-ee3f-4203-a296-13edbb56a985" Jul 08 17:33:50.304103 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:50.303991 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xn2w6" podUID="78061d5b-da8f-4e57-aabe-71262ec1d1dd" Jul 08 17:33:50.488734 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:50.488703 2552 generic.go:356] "Generic (PLEG): container finished" podID="3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa" containerID="81cb747113eaf80220b29d1b7246f676fc6c69cdffaba6552da6c08134b59491" exitCode=0 Jul 08 17:33:50.489227 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:50.488796 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvhnq" event={"ID":"3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa","Type":"ContainerDied","Data":"81cb747113eaf80220b29d1b7246f676fc6c69cdffaba6552da6c08134b59491"} Jul 08 17:33:51.380989 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:51.380957 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6nt78"] Jul 08 17:33:51.381221 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:51.381098 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nt78" Jul 08 17:33:51.381221 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:51.381192 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nt78" podUID="309592bc-ee3f-4203-a296-13edbb56a985" Jul 08 17:33:51.383209 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:51.383186 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xn2w6"] Jul 08 17:33:51.383330 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:51.383275 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xn2w6" Jul 08 17:33:51.383388 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:51.383350 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xn2w6" podUID="78061d5b-da8f-4e57-aabe-71262ec1d1dd" Jul 08 17:33:51.386012 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:51.385988 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xcp9j"] Jul 08 17:33:51.386121 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:51.386105 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcp9j" Jul 08 17:33:51.386237 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:51.386216 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcp9j" podUID="d359c83a-ba83-4914-85cc-d2b35b37759c" Jul 08 17:33:53.301117 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:53.301038 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nt78" Jul 08 17:33:53.301591 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:53.301158 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xn2w6" Jul 08 17:33:53.301591 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:53.301174 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nt78" podUID="309592bc-ee3f-4203-a296-13edbb56a985" Jul 08 17:33:53.301591 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:53.301195 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcp9j" Jul 08 17:33:53.301591 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:53.301295 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xn2w6" podUID="78061d5b-da8f-4e57-aabe-71262ec1d1dd" Jul 08 17:33:53.301591 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:53.301402 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcp9j" podUID="d359c83a-ba83-4914-85cc-d2b35b37759c" Jul 08 17:33:53.501440 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:53.501404 2552 generic.go:356] "Generic (PLEG): container finished" podID="3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa" containerID="a73a3c6b262deeb28153ae6b2b4cba8d80458c710263de2b974330354ac635d7" exitCode=0 Jul 08 17:33:53.501635 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:53.501453 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvhnq" event={"ID":"3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa","Type":"ContainerDied","Data":"a73a3c6b262deeb28153ae6b2b4cba8d80458c710263de2b974330354ac635d7"} Jul 08 17:33:55.300776 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:55.300612 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcp9j" Jul 08 17:33:55.301154 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:55.300647 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nt78" Jul 08 17:33:55.301154 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:55.300854 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xcp9j" podUID="d359c83a-ba83-4914-85cc-d2b35b37759c" Jul 08 17:33:55.301154 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:55.300694 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xn2w6" Jul 08 17:33:55.301154 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:55.300930 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6nt78" podUID="309592bc-ee3f-4203-a296-13edbb56a985" Jul 08 17:33:55.301154 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:55.301027 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xn2w6" podUID="78061d5b-da8f-4e57-aabe-71262ec1d1dd" Jul 08 17:33:55.507478 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:55.507449 2552 generic.go:356] "Generic (PLEG): container finished" podID="3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa" containerID="209b594fa57e914b56de00bb418526187520f416d50f283fdc400cfd075ecf26" exitCode=0 Jul 08 17:33:55.507632 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:55.507501 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvhnq" event={"ID":"3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa","Type":"ContainerDied","Data":"209b594fa57e914b56de00bb418526187520f416d50f283fdc400cfd075ecf26"} Jul 08 17:33:55.941154 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:55.941122 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/309592bc-ee3f-4203-a296-13edbb56a985-original-pull-secret\") pod \"global-pull-secret-syncer-6nt78\" (UID: \"309592bc-ee3f-4203-a296-13edbb56a985\") " pod="kube-system/global-pull-secret-syncer-6nt78" Jul 08 17:33:55.941154 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:55.941173 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d359c83a-ba83-4914-85cc-d2b35b37759c-metrics-certs\") pod \"network-metrics-daemon-xcp9j\" (UID: \"d359c83a-ba83-4914-85cc-d2b35b37759c\") " pod="openshift-multus/network-metrics-daemon-xcp9j" Jul 08 17:33:55.941413 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:55.941286 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 17:33:55.941413 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:55.941317 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:33:55.941413 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:55.941356 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/309592bc-ee3f-4203-a296-13edbb56a985-original-pull-secret podName:309592bc-ee3f-4203-a296-13edbb56a985 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:27.941338268 +0000 UTC m=+66.177730504 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/309592bc-ee3f-4203-a296-13edbb56a985-original-pull-secret") pod "global-pull-secret-syncer-6nt78" (UID: "309592bc-ee3f-4203-a296-13edbb56a985") : object "kube-system"/"original-pull-secret" not registered Jul 08 17:33:55.941413 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:55.941371 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d359c83a-ba83-4914-85cc-d2b35b37759c-metrics-certs podName:d359c83a-ba83-4914-85cc-d2b35b37759c nodeName:}" failed. No retries permitted until 2026-07-08 17:34:27.941365125 +0000 UTC m=+66.177757355 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d359c83a-ba83-4914-85cc-d2b35b37759c-metrics-certs") pod "network-metrics-daemon-xcp9j" (UID: "d359c83a-ba83-4914-85cc-d2b35b37759c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 17:33:56.042100 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:56.042063 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkl7r\" (UniqueName: \"kubernetes.io/projected/78061d5b-da8f-4e57-aabe-71262ec1d1dd-kube-api-access-jkl7r\") pod \"network-check-target-xn2w6\" (UID: \"78061d5b-da8f-4e57-aabe-71262ec1d1dd\") " pod="openshift-network-diagnostics/network-check-target-xn2w6" Jul 08 17:33:56.042269 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:56.042238 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 17:33:56.042269 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:56.042262 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 17:33:56.042359 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:56.042274 2552 projected.go:196] Error preparing data for projected volume kube-api-access-jkl7r for pod openshift-network-diagnostics/network-check-target-xn2w6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:33:56.042359 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:56.042333 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/78061d5b-da8f-4e57-aabe-71262ec1d1dd-kube-api-access-jkl7r podName:78061d5b-da8f-4e57-aabe-71262ec1d1dd nodeName:}" failed. No retries permitted until 2026-07-08 17:34:28.042318128 +0000 UTC m=+66.278710359 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jkl7r" (UniqueName: "kubernetes.io/projected/78061d5b-da8f-4e57-aabe-71262ec1d1dd-kube-api-access-jkl7r") pod "network-check-target-xn2w6" (UID: "78061d5b-da8f-4e57-aabe-71262ec1d1dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 17:33:57.093154 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.093112 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-38.ec2.internal" event="NodeReady" Jul 08 17:33:57.093621 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.093280 2552 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 08 17:33:57.140242 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.139620 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-kkc6p"] Jul 08 17:33:57.141552 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.141517 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vbzn4"] Jul 08 17:33:57.141675 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.141657 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-kkc6p" Jul 08 17:33:57.143578 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.143473 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5c988458c8-vlhfb"] Jul 08 17:33:57.143730 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.143711 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vbzn4" Jul 08 17:33:57.144695 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.144678 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 08 17:33:57.145051 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.145024 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-mnhqg"] Jul 08 17:33:57.145147 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.145131 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:33:57.146511 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.146497 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hjp8j"] Jul 08 17:33:57.146620 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.146604 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-mnhqg" Jul 08 17:33:57.147088 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.147061 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 08 17:33:57.147506 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.147488 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 08 17:33:57.147608 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.147510 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-xx5l6\"" Jul 08 17:33:57.147608 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.147568 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 08 17:33:57.147709 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.147609 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 08 17:33:57.147793 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.147778 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 08 17:33:57.147793 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.147790 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 08 17:33:57.147953 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.147937 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-cb559779c-fbv6t"] Jul 08 17:33:57.148055 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.148040 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hjp8j" Jul 08 17:33:57.148491 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.148466 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 08 17:33:57.148786 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.148733 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 08 17:33:57.148786 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.148756 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 08 17:33:57.149330 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.149314 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-kdzhb\"" Jul 08 17:33:57.149330 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.149321 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5tcwq\"" Jul 08 17:33:57.149481 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.149365 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 08 17:33:57.150085 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.149859 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jbpgz"] Jul 08 17:33:57.150201 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.150185 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 08 17:33:57.150814 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.150347 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-cb559779c-fbv6t" Jul 08 17:33:57.150814 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.150512 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-29j7f\"" Jul 08 17:33:57.150814 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.150665 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:33:57.151125 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.151106 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 08 17:33:57.151719 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.151703 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gnjct"] Jul 08 17:33:57.151850 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.151830 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 08 17:33:57.151942 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.151923 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 08 17:33:57.152007 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.151969 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-69swm\"" Jul 08 17:33:57.152062 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.152010 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:33:57.152205 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.152187 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jbpgz" Jul 08 17:33:57.153563 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.153525 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 08 17:33:57.153674 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.153647 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 08 17:33:57.153738 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.153679 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gnjct" Jul 08 17:33:57.153738 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.153710 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 08 17:33:57.154310 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.153836 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 08 17:33:57.154310 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.153902 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 08 17:33:57.155488 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.155439 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 08 17:33:57.156112 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.155831 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mfr5w\"" Jul 08 17:33:57.156112 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.155919 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 08 17:33:57.156305 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.156130 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 08 17:33:57.156305 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.156244 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 08 17:33:57.159228 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.156463 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 08 17:33:57.159228 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.156842 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5pnx2\"" Jul 08 17:33:57.159228 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.156872 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:33:57.159228 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.156911 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 08 17:33:57.159228 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.156970 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:33:57.159228 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.157121 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-wrzmg\"" Jul 08 17:33:57.164686 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.164659 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 08 17:33:57.164789 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.164713 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 08 17:33:57.165396 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.165377 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 08 17:33:57.166016 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.165905 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-mnhqg"] Jul 08 17:33:57.166793 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.166641 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vbzn4"] Jul 08 17:33:57.167615 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.167596 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hjp8j"] Jul 08 17:33:57.168019 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.167991 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-kkc6p"] Jul 08 17:33:57.168725 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.168708 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-cb559779c-fbv6t"] Jul 08 17:33:57.171004 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.170984 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gnjct"] Jul 08 17:33:57.173990 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.173971 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6nwml"] Jul 08 17:33:57.178098 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.177716 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fb5wd"] Jul 08 17:33:57.178221 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.178201 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6nwml" Jul 08 17:33:57.179733 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.179714 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ngz76"] Jul 08 17:33:57.179951 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.179934 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fb5wd" Jul 08 17:33:57.180839 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.180818 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 08 17:33:57.181688 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.181125 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-99df5\"" Jul 08 17:33:57.181688 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.181300 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 08 17:33:57.182107 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.182088 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-r5djz"] Jul 08 17:33:57.182231 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.182152 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ngz76" Jul 08 17:33:57.182231 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.182091 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 08 17:33:57.182703 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.182677 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-4rwqc\"" Jul 08 17:33:57.183090 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.183072 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 08 17:33:57.183242 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.183225 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 08 17:33:57.183834 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.183815 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-dv6x4"] Jul 08 17:33:57.183949 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.183934 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-r5djz" Jul 08 17:33:57.184359 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.184331 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:33:57.184477 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.184461 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 08 17:33:57.185050 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.185032 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 08 17:33:57.186602 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.185588 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 08 17:33:57.186602 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.185776 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-45wzh\"" Jul 08 17:33:57.186854 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.186800 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 08 17:33:57.186915 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.186863 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-dv6x4" Jul 08 17:33:57.187392 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.187362 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 08 17:33:57.187585 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.187563 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jbpgz"] Jul 08 17:33:57.188055 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.187732 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-cwdjj\"" Jul 08 17:33:57.189452 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.189435 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-7psgl\"" Jul 08 17:33:57.189751 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.189735 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 17:33:57.189886 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.189736 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c988458c8-vlhfb"] Jul 08 17:33:57.190906 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.190887 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 17:33:57.194481 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.194461 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ngz76"] Jul 08 17:33:57.198988 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.198968 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fb5wd"] Jul 08 17:33:57.200757 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.200736 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6nwml"] Jul 08 17:33:57.206596 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.206566 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-r5djz"] Jul 08 17:33:57.208958 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.208936 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-dv6x4"] Jul 08 17:33:57.251141 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.251116 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhsd4\" (UniqueName: \"kubernetes.io/projected/6a728e39-6156-4484-91e0-d9fdf3caf22e-kube-api-access-hhsd4\") pod \"cluster-monitoring-operator-64786d9cbb-vbzn4\" (UID: \"6a728e39-6156-4484-91e0-d9fdf3caf22e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vbzn4" Jul 08 17:33:57.251244 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.251156 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be4b19c2-731c-4888-9120-ab3330cd01e9-tmp\") pod \"insights-operator-5c847dcfc4-kkc6p\" (UID: \"be4b19c2-731c-4888-9120-ab3330cd01e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-kkc6p" Jul 08 17:33:57.251244 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.251181 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9v5l\" (UniqueName: \"kubernetes.io/projected/eb33c2b1-0214-4114-8873-f58efeea8193-kube-api-access-p9v5l\") pod \"dns-default-6nwml\" (UID: \"eb33c2b1-0214-4114-8873-f58efeea8193\") " pod="openshift-dns/dns-default-6nwml" Jul 08 17:33:57.251336 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.251233 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjgwp\" (UniqueName: \"kubernetes.io/projected/3e112127-3239-4a4f-b7bd-860ef4225433-kube-api-access-xjgwp\") pod \"volume-data-source-validator-5d456fdbcd-hjp8j\" (UID: \"3e112127-3239-4a4f-b7bd-860ef4225433\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hjp8j" Jul 08 17:33:57.251336 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.251273 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/12e2c475-d57a-4902-a4ea-810948c00c4d-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-gnjct\" (UID: \"12e2c475-d57a-4902-a4ea-810948c00c4d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gnjct" Jul 08 17:33:57.251336 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.251300 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/eba717c9-222d-4dcf-a495-4e79977b5a93-stats-auth\") pod \"router-default-cb559779c-fbv6t\" (UID: \"eba717c9-222d-4dcf-a495-4e79977b5a93\") " pod="openshift-ingress/router-default-cb559779c-fbv6t" Jul 08 17:33:57.251336 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.251323 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eba717c9-222d-4dcf-a495-4e79977b5a93-metrics-certs\") pod \"router-default-cb559779c-fbv6t\" (UID: \"eba717c9-222d-4dcf-a495-4e79977b5a93\") " pod="openshift-ingress/router-default-cb559779c-fbv6t" Jul 08 17:33:57.251477 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.251350 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/058a4314-4829-4b3d-a275-477b305bcf91-config\") pod \"console-operator-68b757fb67-mnhqg\" (UID: \"058a4314-4829-4b3d-a275-477b305bcf91\") " pod="openshift-console-operator/console-operator-68b757fb67-mnhqg" Jul 08 17:33:57.251477 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.251374 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htpnc\" (UniqueName: \"kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-kube-api-access-htpnc\") pod \"image-registry-5c988458c8-vlhfb\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:33:57.251477 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.251397 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/058a4314-4829-4b3d-a275-477b305bcf91-serving-cert\") pod \"console-operator-68b757fb67-mnhqg\" (UID: \"058a4314-4829-4b3d-a275-477b305bcf91\") " pod="openshift-console-operator/console-operator-68b757fb67-mnhqg" Jul 08 17:33:57.251477 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.251423 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/058a4314-4829-4b3d-a275-477b305bcf91-trusted-ca\") pod \"console-operator-68b757fb67-mnhqg\" (UID: \"058a4314-4829-4b3d-a275-477b305bcf91\") " pod="openshift-console-operator/console-operator-68b757fb67-mnhqg" Jul 08 17:33:57.251477 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.251451 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/12e2c475-d57a-4902-a4ea-810948c00c4d-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-gnjct\" (UID: \"12e2c475-d57a-4902-a4ea-810948c00c4d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gnjct" Jul 08 17:33:57.251477 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.251473 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eba717c9-222d-4dcf-a495-4e79977b5a93-service-ca-bundle\") pod \"router-default-cb559779c-fbv6t\" (UID: \"eba717c9-222d-4dcf-a495-4e79977b5a93\") " pod="openshift-ingress/router-default-cb559779c-fbv6t" Jul 08 17:33:57.251740 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.251564 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6t8j\" (UniqueName: \"kubernetes.io/projected/df5881fe-22be-4a83-a4b4-616788ea2372-kube-api-access-m6t8j\") pod \"cluster-samples-operator-56fcf86bf-jbpgz\" (UID: \"df5881fe-22be-4a83-a4b4-616788ea2372\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jbpgz" Jul 08 17:33:57.251740 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.251598 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtj6s\" (UniqueName: \"kubernetes.io/projected/a9cbbc55-704c-42c5-8ef9-c1847dd931b5-kube-api-access-gtj6s\") pod \"service-ca-operator-5d46d9ffd4-fb5wd\" (UID: \"a9cbbc55-704c-42c5-8ef9-c1847dd931b5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fb5wd" Jul 08 17:33:57.251740 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.251634 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/eb33c2b1-0214-4114-8873-f58efeea8193-config-volume\") pod \"dns-default-6nwml\" (UID: \"eb33c2b1-0214-4114-8873-f58efeea8193\") " pod="openshift-dns/dns-default-6nwml" Jul 08 17:33:57.251740 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.251652 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/df5881fe-22be-4a83-a4b4-616788ea2372-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-jbpgz\" (UID: \"df5881fe-22be-4a83-a4b4-616788ea2372\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jbpgz" Jul 08 17:33:57.251740 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.251669 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r67h\" (UniqueName: \"kubernetes.io/projected/be4b19c2-731c-4888-9120-ab3330cd01e9-kube-api-access-2r67h\") pod \"insights-operator-5c847dcfc4-kkc6p\" (UID: \"be4b19c2-731c-4888-9120-ab3330cd01e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-kkc6p" Jul 08 17:33:57.251740 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.251693 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/eba717c9-222d-4dcf-a495-4e79977b5a93-default-certificate\") pod \"router-default-cb559779c-fbv6t\" (UID: \"eba717c9-222d-4dcf-a495-4e79977b5a93\") " pod="openshift-ingress/router-default-cb559779c-fbv6t" Jul 08 17:33:57.251740 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.251726 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6a728e39-6156-4484-91e0-d9fdf3caf22e-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-vbzn4\" (UID: \"6a728e39-6156-4484-91e0-d9fdf3caf22e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vbzn4" Jul 08 17:33:57.252041 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.251756 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a9cbbc55-704c-42c5-8ef9-c1847dd931b5-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-fb5wd\" (UID: \"a9cbbc55-704c-42c5-8ef9-c1847dd931b5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fb5wd" Jul 08 17:33:57.252041 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.251804 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vlkn\" (UniqueName: \"kubernetes.io/projected/12e2c475-d57a-4902-a4ea-810948c00c4d-kube-api-access-4vlkn\") pod \"kube-storage-version-migrator-operator-846bf668f7-gnjct\" (UID: \"12e2c475-d57a-4902-a4ea-810948c00c4d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gnjct" Jul 08 17:33:57.252041 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.251828 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-image-registry-private-configuration\") pod \"image-registry-5c988458c8-vlhfb\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:33:57.252041 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.251869 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a728e39-6156-4484-91e0-d9fdf3caf22e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vbzn4\" (UID: \"6a728e39-6156-4484-91e0-d9fdf3caf22e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vbzn4" Jul 08 17:33:57.252041 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.251886 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a9cbbc55-704c-42c5-8ef9-c1847dd931b5-config\") pod \"service-ca-operator-5d46d9ffd4-fb5wd\" (UID: \"a9cbbc55-704c-42c5-8ef9-c1847dd931b5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fb5wd" Jul 08 17:33:57.252041 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.251910 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb33c2b1-0214-4114-8873-f58efeea8193-metrics-tls\") pod \"dns-default-6nwml\" (UID: \"eb33c2b1-0214-4114-8873-f58efeea8193\") " pod="openshift-dns/dns-default-6nwml" Jul 08 17:33:57.252041 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.251931 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/be4b19c2-731c-4888-9120-ab3330cd01e9-snapshots\") pod \"insights-operator-5c847dcfc4-kkc6p\" (UID: \"be4b19c2-731c-4888-9120-ab3330cd01e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-kkc6p" Jul 08 17:33:57.252041 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.251946 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be4b19c2-731c-4888-9120-ab3330cd01e9-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-kkc6p\" (UID: \"be4b19c2-731c-4888-9120-ab3330cd01e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-kkc6p" Jul 08 17:33:57.252041 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.251965 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-registry-tls\") pod \"image-registry-5c988458c8-vlhfb\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:33:57.252041 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.251988 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb33c2b1-0214-4114-8873-f58efeea8193-tmp-dir\") pod \"dns-default-6nwml\" (UID: \"eb33c2b1-0214-4114-8873-f58efeea8193\") " pod="openshift-dns/dns-default-6nwml" Jul 08 17:33:57.252484 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.252048 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/be4b19c2-731c-4888-9120-ab3330cd01e9-serving-cert\") pod \"insights-operator-5c847dcfc4-kkc6p\" (UID: \"be4b19c2-731c-4888-9120-ab3330cd01e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-kkc6p" Jul 08 17:33:57.252484 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.252072 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zcxw\" (UniqueName: \"kubernetes.io/projected/058a4314-4829-4b3d-a275-477b305bcf91-kube-api-access-7zcxw\") pod \"console-operator-68b757fb67-mnhqg\" (UID: \"058a4314-4829-4b3d-a275-477b305bcf91\") " pod="openshift-console-operator/console-operator-68b757fb67-mnhqg" Jul 08 17:33:57.252484 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.252090 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-registry-certificates\") pod \"image-registry-5c988458c8-vlhfb\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:33:57.252484 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.252106 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-trusted-ca\") pod \"image-registry-5c988458c8-vlhfb\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:33:57.252484 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.252122 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-installation-pull-secrets\") pod \"image-registry-5c988458c8-vlhfb\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:33:57.252484 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.252144 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-bound-sa-token\") pod \"image-registry-5c988458c8-vlhfb\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:33:57.252484 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.252170 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-ca-trust-extracted\") pod \"image-registry-5c988458c8-vlhfb\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:33:57.252484 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.252196 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4dqc\" (UniqueName: \"kubernetes.io/projected/eba717c9-222d-4dcf-a495-4e79977b5a93-kube-api-access-x4dqc\") pod \"router-default-cb559779c-fbv6t\" (UID: \"eba717c9-222d-4dcf-a495-4e79977b5a93\") " pod="openshift-ingress/router-default-cb559779c-fbv6t" Jul 08 17:33:57.252484 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.252236 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be4b19c2-731c-4888-9120-ab3330cd01e9-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-kkc6p\" (UID: \"be4b19c2-731c-4888-9120-ab3330cd01e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-kkc6p" Jul 08 17:33:57.301141 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.301113 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcp9j" Jul 08 17:33:57.301288 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.301113 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nt78" Jul 08 17:33:57.301361 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.301113 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xn2w6" Jul 08 17:33:57.303503 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.303472 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lzq8f\"" Jul 08 17:33:57.303626 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.303520 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 17:33:57.303626 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.303532 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vntcc\"" Jul 08 17:33:57.303626 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.303578 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 17:33:57.353488 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.353428 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6t8j\" (UniqueName: \"kubernetes.io/projected/df5881fe-22be-4a83-a4b4-616788ea2372-kube-api-access-m6t8j\") pod \"cluster-samples-operator-56fcf86bf-jbpgz\" (UID: \"df5881fe-22be-4a83-a4b4-616788ea2372\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jbpgz" Jul 08 17:33:57.353488 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.353459 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtj6s\" (UniqueName: \"kubernetes.io/projected/a9cbbc55-704c-42c5-8ef9-c1847dd931b5-kube-api-access-gtj6s\") pod \"service-ca-operator-5d46d9ffd4-fb5wd\" (UID: \"a9cbbc55-704c-42c5-8ef9-c1847dd931b5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fb5wd" Jul 08 17:33:57.353488 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.353487 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/eb33c2b1-0214-4114-8873-f58efeea8193-config-volume\") pod \"dns-default-6nwml\" (UID: \"eb33c2b1-0214-4114-8873-f58efeea8193\") " pod="openshift-dns/dns-default-6nwml" Jul 08 17:33:57.353761 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.353737 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj8xh\" (UniqueName: \"kubernetes.io/projected/d5bdfe96-0ab4-4173-90bb-538d09c747d2-kube-api-access-zj8xh\") pod \"ingress-canary-ngz76\" (UID: \"d5bdfe96-0ab4-4173-90bb-538d09c747d2\") " pod="openshift-ingress-canary/ingress-canary-ngz76" Jul 08 17:33:57.353837 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.353815 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/df5881fe-22be-4a83-a4b4-616788ea2372-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-jbpgz\" (UID: \"df5881fe-22be-4a83-a4b4-616788ea2372\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jbpgz" Jul 08 17:33:57.353890 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.353844 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r67h\" (UniqueName: \"kubernetes.io/projected/be4b19c2-731c-4888-9120-ab3330cd01e9-kube-api-access-2r67h\") pod \"insights-operator-5c847dcfc4-kkc6p\" (UID: \"be4b19c2-731c-4888-9120-ab3330cd01e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-kkc6p" Jul 08 17:33:57.353890 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.353873 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/eba717c9-222d-4dcf-a495-4e79977b5a93-default-certificate\") pod \"router-default-cb559779c-fbv6t\" (UID: \"eba717c9-222d-4dcf-a495-4e79977b5a93\") " pod="openshift-ingress/router-default-cb559779c-fbv6t" Jul 08 17:33:57.353988 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.353899 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6a728e39-6156-4484-91e0-d9fdf3caf22e-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-vbzn4\" (UID: \"6a728e39-6156-4484-91e0-d9fdf3caf22e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vbzn4" Jul 08 17:33:57.353988 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:57.353913 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 17:33:57.353988 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.353923 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a9cbbc55-704c-42c5-8ef9-c1847dd931b5-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-fb5wd\" (UID: \"a9cbbc55-704c-42c5-8ef9-c1847dd931b5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fb5wd" Jul 08 17:33:57.353988 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.353949 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d5bdfe96-0ab4-4173-90bb-538d09c747d2-cert\") pod \"ingress-canary-ngz76\" (UID: \"d5bdfe96-0ab4-4173-90bb-538d09c747d2\") " pod="openshift-ingress-canary/ingress-canary-ngz76" Jul 08 17:33:57.353988 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:57.353979 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df5881fe-22be-4a83-a4b4-616788ea2372-samples-operator-tls podName:df5881fe-22be-4a83-a4b4-616788ea2372 nodeName:}" failed. No retries permitted until 2026-07-08 17:33:57.853961177 +0000 UTC m=+36.090353413 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/df5881fe-22be-4a83-a4b4-616788ea2372-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-jbpgz" (UID: "df5881fe-22be-4a83-a4b4-616788ea2372") : secret "samples-operator-tls" not found Jul 08 17:33:57.354173 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.354002 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vlkn\" (UniqueName: \"kubernetes.io/projected/12e2c475-d57a-4902-a4ea-810948c00c4d-kube-api-access-4vlkn\") pod \"kube-storage-version-migrator-operator-846bf668f7-gnjct\" (UID: \"12e2c475-d57a-4902-a4ea-810948c00c4d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gnjct" Jul 08 17:33:57.354173 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.354045 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-image-registry-private-configuration\") pod \"image-registry-5c988458c8-vlhfb\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:33:57.354173 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.354088 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a728e39-6156-4484-91e0-d9fdf3caf22e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vbzn4\" (UID: \"6a728e39-6156-4484-91e0-d9fdf3caf22e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vbzn4" Jul 08 17:33:57.354173 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.354114 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a9cbbc55-704c-42c5-8ef9-c1847dd931b5-config\") pod \"service-ca-operator-5d46d9ffd4-fb5wd\" (UID: \"a9cbbc55-704c-42c5-8ef9-c1847dd931b5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fb5wd" Jul 08 17:33:57.354173 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.354145 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb33c2b1-0214-4114-8873-f58efeea8193-metrics-tls\") pod \"dns-default-6nwml\" (UID: \"eb33c2b1-0214-4114-8873-f58efeea8193\") " pod="openshift-dns/dns-default-6nwml" Jul 08 17:33:57.354173 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.354169 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/be4b19c2-731c-4888-9120-ab3330cd01e9-snapshots\") pod \"insights-operator-5c847dcfc4-kkc6p\" (UID: \"be4b19c2-731c-4888-9120-ab3330cd01e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-kkc6p" Jul 08 17:33:57.354343 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.354181 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/eb33c2b1-0214-4114-8873-f58efeea8193-config-volume\") pod \"dns-default-6nwml\" (UID: \"eb33c2b1-0214-4114-8873-f58efeea8193\") " pod="openshift-dns/dns-default-6nwml" Jul 08 17:33:57.354343 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.354193 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be4b19c2-731c-4888-9120-ab3330cd01e9-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-kkc6p\" (UID: \"be4b19c2-731c-4888-9120-ab3330cd01e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-kkc6p" Jul 08 17:33:57.354343 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.354233 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-registry-tls\") pod \"image-registry-5c988458c8-vlhfb\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:33:57.354343 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.354258 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb33c2b1-0214-4114-8873-f58efeea8193-tmp-dir\") pod \"dns-default-6nwml\" (UID: \"eb33c2b1-0214-4114-8873-f58efeea8193\") " pod="openshift-dns/dns-default-6nwml" Jul 08 17:33:57.354343 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.354278 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/be4b19c2-731c-4888-9120-ab3330cd01e9-serving-cert\") pod \"insights-operator-5c847dcfc4-kkc6p\" (UID: \"be4b19c2-731c-4888-9120-ab3330cd01e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-kkc6p" Jul 08 17:33:57.354343 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.354301 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/84f80313-db9a-4e96-b7e0-41817cd010cd-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-r5djz\" (UID: \"84f80313-db9a-4e96-b7e0-41817cd010cd\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-r5djz" Jul 08 17:33:57.354343 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.354329 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zcxw\" (UniqueName: \"kubernetes.io/projected/058a4314-4829-4b3d-a275-477b305bcf91-kube-api-access-7zcxw\") pod \"console-operator-68b757fb67-mnhqg\" (UID: \"058a4314-4829-4b3d-a275-477b305bcf91\") " pod="openshift-console-operator/console-operator-68b757fb67-mnhqg" Jul 08 17:33:57.354565 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.354357 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-registry-certificates\") pod \"image-registry-5c988458c8-vlhfb\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:33:57.354565 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.354386 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-trusted-ca\") pod \"image-registry-5c988458c8-vlhfb\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:33:57.354565 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.354407 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-installation-pull-secrets\") pod \"image-registry-5c988458c8-vlhfb\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:33:57.354565 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.354427 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-bound-sa-token\") pod \"image-registry-5c988458c8-vlhfb\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:33:57.354565 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.354446 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-ca-trust-extracted\") pod \"image-registry-5c988458c8-vlhfb\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:33:57.354565 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.354472 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4dqc\" (UniqueName: \"kubernetes.io/projected/eba717c9-222d-4dcf-a495-4e79977b5a93-kube-api-access-x4dqc\") pod \"router-default-cb559779c-fbv6t\" (UID: \"eba717c9-222d-4dcf-a495-4e79977b5a93\") " pod="openshift-ingress/router-default-cb559779c-fbv6t" Jul 08 17:33:57.354565 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.354499 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/84f80313-db9a-4e96-b7e0-41817cd010cd-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-r5djz\" (UID: \"84f80313-db9a-4e96-b7e0-41817cd010cd\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-r5djz" Jul 08 17:33:57.354565 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.354524 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb6m5\" (UniqueName: \"kubernetes.io/projected/fc5a9365-5086-4814-b394-cb0cc249d1ff-kube-api-access-rb6m5\") pod \"network-check-source-989f8b8dc-dv6x4\" (UID: \"fc5a9365-5086-4814-b394-cb0cc249d1ff\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-dv6x4" Jul 08 17:33:57.354925 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.354570 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be4b19c2-731c-4888-9120-ab3330cd01e9-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-kkc6p\" (UID: \"be4b19c2-731c-4888-9120-ab3330cd01e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-kkc6p" Jul 08 17:33:57.354925 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.354588 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6a728e39-6156-4484-91e0-d9fdf3caf22e-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-vbzn4\" (UID: \"6a728e39-6156-4484-91e0-d9fdf3caf22e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vbzn4" Jul 08 17:33:57.354925 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.354639 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be4b19c2-731c-4888-9120-ab3330cd01e9-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-kkc6p\" (UID: \"be4b19c2-731c-4888-9120-ab3330cd01e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-kkc6p" Jul 08 17:33:57.354925 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:57.354681 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:33:57.354925 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:57.354694 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c988458c8-vlhfb: secret "image-registry-tls" not found Jul 08 17:33:57.354925 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:57.354749 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-registry-tls podName:d93a5ee1-5553-4ad9-ade1-352ce4a76d06 nodeName:}" failed. No retries permitted until 2026-07-08 17:33:57.854733029 +0000 UTC m=+36.091125267 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-registry-tls") pod "image-registry-5c988458c8-vlhfb" (UID: "d93a5ee1-5553-4ad9-ade1-352ce4a76d06") : secret "image-registry-tls" not found Jul 08 17:33:57.354925 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.354594 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhsd4\" (UniqueName: \"kubernetes.io/projected/6a728e39-6156-4484-91e0-d9fdf3caf22e-kube-api-access-hhsd4\") pod \"cluster-monitoring-operator-64786d9cbb-vbzn4\" (UID: \"6a728e39-6156-4484-91e0-d9fdf3caf22e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vbzn4" Jul 08 17:33:57.355252 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.354971 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eb33c2b1-0214-4114-8873-f58efeea8193-tmp-dir\") pod \"dns-default-6nwml\" (UID: \"eb33c2b1-0214-4114-8873-f58efeea8193\") " pod="openshift-dns/dns-default-6nwml" Jul 08 17:33:57.355252 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:57.355043 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 17:33:57.355252 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:57.355090 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a728e39-6156-4484-91e0-d9fdf3caf22e-cluster-monitoring-operator-tls podName:6a728e39-6156-4484-91e0-d9fdf3caf22e nodeName:}" failed. No retries permitted until 2026-07-08 17:33:57.855073856 +0000 UTC m=+36.091466105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6a728e39-6156-4484-91e0-d9fdf3caf22e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vbzn4" (UID: "6a728e39-6156-4484-91e0-d9fdf3caf22e") : secret "cluster-monitoring-operator-tls" not found Jul 08 17:33:57.357891 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.355572 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a9cbbc55-704c-42c5-8ef9-c1847dd931b5-config\") pod \"service-ca-operator-5d46d9ffd4-fb5wd\" (UID: \"a9cbbc55-704c-42c5-8ef9-c1847dd931b5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fb5wd" Jul 08 17:33:57.357891 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.355644 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be4b19c2-731c-4888-9120-ab3330cd01e9-tmp\") pod \"insights-operator-5c847dcfc4-kkc6p\" (UID: \"be4b19c2-731c-4888-9120-ab3330cd01e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-kkc6p" Jul 08 17:33:57.357891 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.355825 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be4b19c2-731c-4888-9120-ab3330cd01e9-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-kkc6p\" (UID: \"be4b19c2-731c-4888-9120-ab3330cd01e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-kkc6p" Jul 08 17:33:57.357891 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.355920 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-ca-trust-extracted\") pod \"image-registry-5c988458c8-vlhfb\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:33:57.357891 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.356195 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be4b19c2-731c-4888-9120-ab3330cd01e9-tmp\") pod \"insights-operator-5c847dcfc4-kkc6p\" (UID: \"be4b19c2-731c-4888-9120-ab3330cd01e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-kkc6p" Jul 08 17:33:57.357891 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.356248 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9v5l\" (UniqueName: \"kubernetes.io/projected/eb33c2b1-0214-4114-8873-f58efeea8193-kube-api-access-p9v5l\") pod \"dns-default-6nwml\" (UID: \"eb33c2b1-0214-4114-8873-f58efeea8193\") " pod="openshift-dns/dns-default-6nwml" Jul 08 17:33:57.357891 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.356291 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-registry-certificates\") pod \"image-registry-5c988458c8-vlhfb\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:33:57.357891 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.356305 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjgwp\" (UniqueName: \"kubernetes.io/projected/3e112127-3239-4a4f-b7bd-860ef4225433-kube-api-access-xjgwp\") pod \"volume-data-source-validator-5d456fdbcd-hjp8j\" (UID: \"3e112127-3239-4a4f-b7bd-860ef4225433\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hjp8j" Jul 08 17:33:57.357891 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.356332 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/12e2c475-d57a-4902-a4ea-810948c00c4d-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-gnjct\" (UID: \"12e2c475-d57a-4902-a4ea-810948c00c4d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gnjct" Jul 08 17:33:57.357891 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.356356 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/eba717c9-222d-4dcf-a495-4e79977b5a93-stats-auth\") pod \"router-default-cb559779c-fbv6t\" (UID: \"eba717c9-222d-4dcf-a495-4e79977b5a93\") " pod="openshift-ingress/router-default-cb559779c-fbv6t" Jul 08 17:33:57.357891 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.356560 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eba717c9-222d-4dcf-a495-4e79977b5a93-metrics-certs\") pod \"router-default-cb559779c-fbv6t\" (UID: \"eba717c9-222d-4dcf-a495-4e79977b5a93\") " pod="openshift-ingress/router-default-cb559779c-fbv6t" Jul 08 17:33:57.357891 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.356596 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/058a4314-4829-4b3d-a275-477b305bcf91-config\") pod \"console-operator-68b757fb67-mnhqg\" (UID: \"058a4314-4829-4b3d-a275-477b305bcf91\") " pod="openshift-console-operator/console-operator-68b757fb67-mnhqg" Jul 08 17:33:57.357891 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.356650 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htpnc\" (UniqueName: \"kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-kube-api-access-htpnc\") pod \"image-registry-5c988458c8-vlhfb\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:33:57.357891 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.356678 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/058a4314-4829-4b3d-a275-477b305bcf91-serving-cert\") pod \"console-operator-68b757fb67-mnhqg\" (UID: \"058a4314-4829-4b3d-a275-477b305bcf91\") " pod="openshift-console-operator/console-operator-68b757fb67-mnhqg" Jul 08 17:33:57.357891 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:57.356757 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:33:57.357891 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:57.356795 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb33c2b1-0214-4114-8873-f58efeea8193-metrics-tls podName:eb33c2b1-0214-4114-8873-f58efeea8193 nodeName:}" failed. No retries permitted until 2026-07-08 17:33:57.85678195 +0000 UTC m=+36.093174209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eb33c2b1-0214-4114-8873-f58efeea8193-metrics-tls") pod "dns-default-6nwml" (UID: "eb33c2b1-0214-4114-8873-f58efeea8193") : secret "dns-default-metrics-tls" not found Jul 08 17:33:57.358725 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.356938 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/be4b19c2-731c-4888-9120-ab3330cd01e9-snapshots\") pod \"insights-operator-5c847dcfc4-kkc6p\" (UID: \"be4b19c2-731c-4888-9120-ab3330cd01e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-kkc6p" Jul 08 17:33:57.358725 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:57.356983 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 17:33:57.358725 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:57.357038 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eba717c9-222d-4dcf-a495-4e79977b5a93-metrics-certs podName:eba717c9-222d-4dcf-a495-4e79977b5a93 nodeName:}" failed. No retries permitted until 2026-07-08 17:33:57.857022272 +0000 UTC m=+36.093414517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eba717c9-222d-4dcf-a495-4e79977b5a93-metrics-certs") pod "router-default-cb559779c-fbv6t" (UID: "eba717c9-222d-4dcf-a495-4e79977b5a93") : secret "router-metrics-certs-default" not found Jul 08 17:33:57.358725 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.357066 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-trusted-ca\") pod \"image-registry-5c988458c8-vlhfb\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:33:57.358725 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.357083 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/058a4314-4829-4b3d-a275-477b305bcf91-trusted-ca\") pod \"console-operator-68b757fb67-mnhqg\" (UID: \"058a4314-4829-4b3d-a275-477b305bcf91\") " pod="openshift-console-operator/console-operator-68b757fb67-mnhqg" Jul 08 17:33:57.358725 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.357142 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/12e2c475-d57a-4902-a4ea-810948c00c4d-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-gnjct\" (UID: \"12e2c475-d57a-4902-a4ea-810948c00c4d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gnjct" Jul 08 17:33:57.358725 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.357174 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eba717c9-222d-4dcf-a495-4e79977b5a93-service-ca-bundle\") pod \"router-default-cb559779c-fbv6t\" (UID: \"eba717c9-222d-4dcf-a495-4e79977b5a93\") " pod="openshift-ingress/router-default-cb559779c-fbv6t" Jul 08 17:33:57.358725 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:57.357328 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eba717c9-222d-4dcf-a495-4e79977b5a93-service-ca-bundle podName:eba717c9-222d-4dcf-a495-4e79977b5a93 nodeName:}" failed. No retries permitted until 2026-07-08 17:33:57.857312285 +0000 UTC m=+36.093704539 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/eba717c9-222d-4dcf-a495-4e79977b5a93-service-ca-bundle") pod "router-default-cb559779c-fbv6t" (UID: "eba717c9-222d-4dcf-a495-4e79977b5a93") : configmap references non-existent config key: service-ca.crt Jul 08 17:33:57.358725 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.357348 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/058a4314-4829-4b3d-a275-477b305bcf91-config\") pod \"console-operator-68b757fb67-mnhqg\" (UID: \"058a4314-4829-4b3d-a275-477b305bcf91\") " pod="openshift-console-operator/console-operator-68b757fb67-mnhqg" Jul 08 17:33:57.358725 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.357852 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/058a4314-4829-4b3d-a275-477b305bcf91-trusted-ca\") pod \"console-operator-68b757fb67-mnhqg\" (UID: \"058a4314-4829-4b3d-a275-477b305bcf91\") " pod="openshift-console-operator/console-operator-68b757fb67-mnhqg" Jul 08 17:33:57.358725 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.357977 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/12e2c475-d57a-4902-a4ea-810948c00c4d-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-gnjct\" (UID: \"12e2c475-d57a-4902-a4ea-810948c00c4d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gnjct" Jul 08 17:33:57.359980 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.359956 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a9cbbc55-704c-42c5-8ef9-c1847dd931b5-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-fb5wd\" (UID: \"a9cbbc55-704c-42c5-8ef9-c1847dd931b5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fb5wd" Jul 08 17:33:57.360079 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.360058 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/058a4314-4829-4b3d-a275-477b305bcf91-serving-cert\") pod \"console-operator-68b757fb67-mnhqg\" (UID: \"058a4314-4829-4b3d-a275-477b305bcf91\") " pod="openshift-console-operator/console-operator-68b757fb67-mnhqg" Jul 08 17:33:57.360134 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.360083 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/be4b19c2-731c-4888-9120-ab3330cd01e9-serving-cert\") pod \"insights-operator-5c847dcfc4-kkc6p\" (UID: \"be4b19c2-731c-4888-9120-ab3330cd01e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-kkc6p" Jul 08 17:33:57.360387 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.360364 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/eba717c9-222d-4dcf-a495-4e79977b5a93-default-certificate\") pod \"router-default-cb559779c-fbv6t\" (UID: \"eba717c9-222d-4dcf-a495-4e79977b5a93\") " pod="openshift-ingress/router-default-cb559779c-fbv6t" Jul 08 17:33:57.361078 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.361035 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-image-registry-private-configuration\") pod \"image-registry-5c988458c8-vlhfb\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:33:57.361697 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.361677 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-installation-pull-secrets\") pod \"image-registry-5c988458c8-vlhfb\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:33:57.362158 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.362127 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/12e2c475-d57a-4902-a4ea-810948c00c4d-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-gnjct\" (UID: \"12e2c475-d57a-4902-a4ea-810948c00c4d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gnjct" Jul 08 17:33:57.362585 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.362564 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/eba717c9-222d-4dcf-a495-4e79977b5a93-stats-auth\") pod \"router-default-cb559779c-fbv6t\" (UID: \"eba717c9-222d-4dcf-a495-4e79977b5a93\") " pod="openshift-ingress/router-default-cb559779c-fbv6t" Jul 08 17:33:57.364690 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.364659 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtj6s\" (UniqueName: \"kubernetes.io/projected/a9cbbc55-704c-42c5-8ef9-c1847dd931b5-kube-api-access-gtj6s\") pod \"service-ca-operator-5d46d9ffd4-fb5wd\" (UID: \"a9cbbc55-704c-42c5-8ef9-c1847dd931b5\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fb5wd" Jul 08 17:33:57.366702 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.366649 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-bound-sa-token\") pod \"image-registry-5c988458c8-vlhfb\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:33:57.366799 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.366777 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zcxw\" (UniqueName: \"kubernetes.io/projected/058a4314-4829-4b3d-a275-477b305bcf91-kube-api-access-7zcxw\") pod \"console-operator-68b757fb67-mnhqg\" (UID: \"058a4314-4829-4b3d-a275-477b305bcf91\") " pod="openshift-console-operator/console-operator-68b757fb67-mnhqg" Jul 08 17:33:57.367970 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.367945 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htpnc\" (UniqueName: \"kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-kube-api-access-htpnc\") pod \"image-registry-5c988458c8-vlhfb\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:33:57.368117 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.368087 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4dqc\" (UniqueName: \"kubernetes.io/projected/eba717c9-222d-4dcf-a495-4e79977b5a93-kube-api-access-x4dqc\") pod \"router-default-cb559779c-fbv6t\" (UID: \"eba717c9-222d-4dcf-a495-4e79977b5a93\") " pod="openshift-ingress/router-default-cb559779c-fbv6t" Jul 08 17:33:57.368639 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.368228 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6t8j\" (UniqueName: \"kubernetes.io/projected/df5881fe-22be-4a83-a4b4-616788ea2372-kube-api-access-m6t8j\") pod \"cluster-samples-operator-56fcf86bf-jbpgz\" (UID: \"df5881fe-22be-4a83-a4b4-616788ea2372\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jbpgz" Jul 08 17:33:57.368882 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.368854 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r67h\" (UniqueName: \"kubernetes.io/projected/be4b19c2-731c-4888-9120-ab3330cd01e9-kube-api-access-2r67h\") pod \"insights-operator-5c847dcfc4-kkc6p\" (UID: \"be4b19c2-731c-4888-9120-ab3330cd01e9\") " pod="openshift-insights/insights-operator-5c847dcfc4-kkc6p" Jul 08 17:33:57.369031 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.369005 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhsd4\" (UniqueName: \"kubernetes.io/projected/6a728e39-6156-4484-91e0-d9fdf3caf22e-kube-api-access-hhsd4\") pod \"cluster-monitoring-operator-64786d9cbb-vbzn4\" (UID: \"6a728e39-6156-4484-91e0-d9fdf3caf22e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vbzn4" Jul 08 17:33:57.369814 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.369763 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vlkn\" (UniqueName: \"kubernetes.io/projected/12e2c475-d57a-4902-a4ea-810948c00c4d-kube-api-access-4vlkn\") pod \"kube-storage-version-migrator-operator-846bf668f7-gnjct\" (UID: \"12e2c475-d57a-4902-a4ea-810948c00c4d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gnjct" Jul 08 17:33:57.370056 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.370033 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9v5l\" (UniqueName: \"kubernetes.io/projected/eb33c2b1-0214-4114-8873-f58efeea8193-kube-api-access-p9v5l\") pod \"dns-default-6nwml\" (UID: \"eb33c2b1-0214-4114-8873-f58efeea8193\") " pod="openshift-dns/dns-default-6nwml" Jul 08 17:33:57.370285 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.370260 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjgwp\" (UniqueName: \"kubernetes.io/projected/3e112127-3239-4a4f-b7bd-860ef4225433-kube-api-access-xjgwp\") pod \"volume-data-source-validator-5d456fdbcd-hjp8j\" (UID: \"3e112127-3239-4a4f-b7bd-860ef4225433\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hjp8j" Jul 08 17:33:57.454182 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.454152 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-kkc6p" Jul 08 17:33:57.458422 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.458403 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj8xh\" (UniqueName: \"kubernetes.io/projected/d5bdfe96-0ab4-4173-90bb-538d09c747d2-kube-api-access-zj8xh\") pod \"ingress-canary-ngz76\" (UID: \"d5bdfe96-0ab4-4173-90bb-538d09c747d2\") " pod="openshift-ingress-canary/ingress-canary-ngz76" Jul 08 17:33:57.458519 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.458454 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d5bdfe96-0ab4-4173-90bb-538d09c747d2-cert\") pod \"ingress-canary-ngz76\" (UID: \"d5bdfe96-0ab4-4173-90bb-538d09c747d2\") " pod="openshift-ingress-canary/ingress-canary-ngz76" Jul 08 17:33:57.458594 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.458562 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/84f80313-db9a-4e96-b7e0-41817cd010cd-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-r5djz\" (UID: \"84f80313-db9a-4e96-b7e0-41817cd010cd\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-r5djz" Jul 08 17:33:57.458652 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.458614 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/84f80313-db9a-4e96-b7e0-41817cd010cd-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-r5djz\" (UID: \"84f80313-db9a-4e96-b7e0-41817cd010cd\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-r5djz" Jul 08 17:33:57.458652 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.458641 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb6m5\" (UniqueName: \"kubernetes.io/projected/fc5a9365-5086-4814-b394-cb0cc249d1ff-kube-api-access-rb6m5\") pod \"network-check-source-989f8b8dc-dv6x4\" (UID: \"fc5a9365-5086-4814-b394-cb0cc249d1ff\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-dv6x4" Jul 08 17:33:57.458863 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:57.458847 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 17:33:57.458931 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:57.458907 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84f80313-db9a-4e96-b7e0-41817cd010cd-networking-console-plugin-cert podName:84f80313-db9a-4e96-b7e0-41817cd010cd nodeName:}" failed. No retries permitted until 2026-07-08 17:33:57.95888659 +0000 UTC m=+36.195278828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/84f80313-db9a-4e96-b7e0-41817cd010cd-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-r5djz" (UID: "84f80313-db9a-4e96-b7e0-41817cd010cd") : secret "networking-console-plugin-cert" not found Jul 08 17:33:57.459282 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.459266 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/84f80313-db9a-4e96-b7e0-41817cd010cd-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-r5djz\" (UID: \"84f80313-db9a-4e96-b7e0-41817cd010cd\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-r5djz" Jul 08 17:33:57.461183 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.461162 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d5bdfe96-0ab4-4173-90bb-538d09c747d2-cert\") pod \"ingress-canary-ngz76\" (UID: \"d5bdfe96-0ab4-4173-90bb-538d09c747d2\") " pod="openshift-ingress-canary/ingress-canary-ngz76" Jul 08 17:33:57.470326 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.470296 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb6m5\" (UniqueName: \"kubernetes.io/projected/fc5a9365-5086-4814-b394-cb0cc249d1ff-kube-api-access-rb6m5\") pod \"network-check-source-989f8b8dc-dv6x4\" (UID: \"fc5a9365-5086-4814-b394-cb0cc249d1ff\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-dv6x4" Jul 08 17:33:57.471709 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.471685 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj8xh\" (UniqueName: \"kubernetes.io/projected/d5bdfe96-0ab4-4173-90bb-538d09c747d2-kube-api-access-zj8xh\") pod \"ingress-canary-ngz76\" (UID: \"d5bdfe96-0ab4-4173-90bb-538d09c747d2\") " pod="openshift-ingress-canary/ingress-canary-ngz76" Jul 08 17:33:57.482580 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.482558 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-mnhqg" Jul 08 17:33:57.491003 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.490986 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hjp8j" Jul 08 17:33:57.517306 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.516941 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gnjct" Jul 08 17:33:57.535449 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.535413 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fb5wd" Jul 08 17:33:57.538188 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.538002 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ngz76" Jul 08 17:33:57.551852 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.551616 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-dv6x4" Jul 08 17:33:57.655770 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.652103 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-kkc6p"] Jul 08 17:33:57.662174 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:57.662104 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe4b19c2_731c_4888_9120_ab3330cd01e9.slice/crio-f81ea1d3c439ff9ed2f8eade59fe385967a27a41be86bc786f8d894c016b4edb WatchSource:0}: Error finding container f81ea1d3c439ff9ed2f8eade59fe385967a27a41be86bc786f8d894c016b4edb: Status 404 returned error can't find the container with id f81ea1d3c439ff9ed2f8eade59fe385967a27a41be86bc786f8d894c016b4edb Jul 08 17:33:57.675409 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.675300 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-mnhqg"] Jul 08 17:33:57.689220 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:57.689182 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod058a4314_4829_4b3d_a275_477b305bcf91.slice/crio-b9dc320dfb9380e288c576ae115054a8a0c44a4503a2a059c829210d3a26f621 WatchSource:0}: Error finding container b9dc320dfb9380e288c576ae115054a8a0c44a4503a2a059c829210d3a26f621: Status 404 returned error can't find the container with id b9dc320dfb9380e288c576ae115054a8a0c44a4503a2a059c829210d3a26f621 Jul 08 17:33:57.718384 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.718307 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hjp8j"] Jul 08 17:33:57.729329 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:57.729298 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e112127_3239_4a4f_b7bd_860ef4225433.slice/crio-5886abf357c19ead5a74675334c9e6f3ad95d875b6f676c4862c6b920ae504e1 WatchSource:0}: Error finding container 5886abf357c19ead5a74675334c9e6f3ad95d875b6f676c4862c6b920ae504e1: Status 404 returned error can't find the container with id 5886abf357c19ead5a74675334c9e6f3ad95d875b6f676c4862c6b920ae504e1 Jul 08 17:33:57.772365 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.772333 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gnjct"] Jul 08 17:33:57.799639 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.799562 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fb5wd"] Jul 08 17:33:57.803848 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:57.803807 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9cbbc55_704c_42c5_8ef9_c1847dd931b5.slice/crio-45cc05260a496794e9968a7cca6740d760fe9e2ed0e8fece6726367b92e31de2 WatchSource:0}: Error finding container 45cc05260a496794e9968a7cca6740d760fe9e2ed0e8fece6726367b92e31de2: Status 404 returned error can't find the container with id 45cc05260a496794e9968a7cca6740d760fe9e2ed0e8fece6726367b92e31de2 Jul 08 17:33:57.829437 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.829412 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ngz76"] Jul 08 17:33:57.831902 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.831879 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-dv6x4"] Jul 08 17:33:57.832225 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:57.832191 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5bdfe96_0ab4_4173_90bb_538d09c747d2.slice/crio-daf0802f10848381a8657cef02998b3b9de47365608be4a37d92d6079357bc2f WatchSource:0}: Error finding container daf0802f10848381a8657cef02998b3b9de47365608be4a37d92d6079357bc2f: Status 404 returned error can't find the container with id daf0802f10848381a8657cef02998b3b9de47365608be4a37d92d6079357bc2f Jul 08 17:33:57.836247 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:33:57.836203 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc5a9365_5086_4814_b394_cb0cc249d1ff.slice/crio-80d3c7cd91db6af970ce8e0c1001f76b21d47fbb39858253065b1ff4fe02026c WatchSource:0}: Error finding container 80d3c7cd91db6af970ce8e0c1001f76b21d47fbb39858253065b1ff4fe02026c: Status 404 returned error can't find the container with id 80d3c7cd91db6af970ce8e0c1001f76b21d47fbb39858253065b1ff4fe02026c Jul 08 17:33:57.863507 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.863473 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a728e39-6156-4484-91e0-d9fdf3caf22e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vbzn4\" (UID: \"6a728e39-6156-4484-91e0-d9fdf3caf22e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vbzn4" Jul 08 17:33:57.863691 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.863515 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb33c2b1-0214-4114-8873-f58efeea8193-metrics-tls\") pod \"dns-default-6nwml\" (UID: \"eb33c2b1-0214-4114-8873-f58efeea8193\") " pod="openshift-dns/dns-default-6nwml" Jul 08 17:33:57.863691 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.863562 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-registry-tls\") pod \"image-registry-5c988458c8-vlhfb\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:33:57.863691 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:57.863635 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 17:33:57.863691 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:57.863660 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:33:57.863691 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:57.863671 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c988458c8-vlhfb: secret "image-registry-tls" not found Jul 08 17:33:57.863691 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:57.863660 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:33:57.863942 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:57.863700 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a728e39-6156-4484-91e0-d9fdf3caf22e-cluster-monitoring-operator-tls podName:6a728e39-6156-4484-91e0-d9fdf3caf22e nodeName:}" failed. No retries permitted until 2026-07-08 17:33:58.863683864 +0000 UTC m=+37.100076126 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6a728e39-6156-4484-91e0-d9fdf3caf22e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vbzn4" (UID: "6a728e39-6156-4484-91e0-d9fdf3caf22e") : secret "cluster-monitoring-operator-tls" not found Jul 08 17:33:57.863942 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:57.863723 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb33c2b1-0214-4114-8873-f58efeea8193-metrics-tls podName:eb33c2b1-0214-4114-8873-f58efeea8193 nodeName:}" failed. No retries permitted until 2026-07-08 17:33:58.863714064 +0000 UTC m=+37.100106294 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eb33c2b1-0214-4114-8873-f58efeea8193-metrics-tls") pod "dns-default-6nwml" (UID: "eb33c2b1-0214-4114-8873-f58efeea8193") : secret "dns-default-metrics-tls" not found Jul 08 17:33:57.863942 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:57.863739 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-registry-tls podName:d93a5ee1-5553-4ad9-ade1-352ce4a76d06 nodeName:}" failed. No retries permitted until 2026-07-08 17:33:58.863731788 +0000 UTC m=+37.100124018 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-registry-tls") pod "image-registry-5c988458c8-vlhfb" (UID: "d93a5ee1-5553-4ad9-ade1-352ce4a76d06") : secret "image-registry-tls" not found Jul 08 17:33:57.863942 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.863777 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eba717c9-222d-4dcf-a495-4e79977b5a93-metrics-certs\") pod \"router-default-cb559779c-fbv6t\" (UID: \"eba717c9-222d-4dcf-a495-4e79977b5a93\") " pod="openshift-ingress/router-default-cb559779c-fbv6t" Jul 08 17:33:57.863942 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.863817 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eba717c9-222d-4dcf-a495-4e79977b5a93-service-ca-bundle\") pod \"router-default-cb559779c-fbv6t\" (UID: \"eba717c9-222d-4dcf-a495-4e79977b5a93\") " pod="openshift-ingress/router-default-cb559779c-fbv6t" Jul 08 17:33:57.863942 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:57.863868 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 17:33:57.863942 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.863880 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/df5881fe-22be-4a83-a4b4-616788ea2372-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-jbpgz\" (UID: \"df5881fe-22be-4a83-a4b4-616788ea2372\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jbpgz" Jul 08 17:33:57.863942 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:57.863924 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eba717c9-222d-4dcf-a495-4e79977b5a93-metrics-certs podName:eba717c9-222d-4dcf-a495-4e79977b5a93 nodeName:}" failed. No retries permitted until 2026-07-08 17:33:58.863904521 +0000 UTC m=+37.100296772 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eba717c9-222d-4dcf-a495-4e79977b5a93-metrics-certs") pod "router-default-cb559779c-fbv6t" (UID: "eba717c9-222d-4dcf-a495-4e79977b5a93") : secret "router-metrics-certs-default" not found Jul 08 17:33:57.864213 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:57.863982 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 17:33:57.864213 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:57.864002 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eba717c9-222d-4dcf-a495-4e79977b5a93-service-ca-bundle podName:eba717c9-222d-4dcf-a495-4e79977b5a93 nodeName:}" failed. No retries permitted until 2026-07-08 17:33:58.863985615 +0000 UTC m=+37.100377851 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/eba717c9-222d-4dcf-a495-4e79977b5a93-service-ca-bundle") pod "router-default-cb559779c-fbv6t" (UID: "eba717c9-222d-4dcf-a495-4e79977b5a93") : configmap references non-existent config key: service-ca.crt Jul 08 17:33:57.864213 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:57.864026 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df5881fe-22be-4a83-a4b4-616788ea2372-samples-operator-tls podName:df5881fe-22be-4a83-a4b4-616788ea2372 nodeName:}" failed. No retries permitted until 2026-07-08 17:33:58.864014281 +0000 UTC m=+37.100406541 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/df5881fe-22be-4a83-a4b4-616788ea2372-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-jbpgz" (UID: "df5881fe-22be-4a83-a4b4-616788ea2372") : secret "samples-operator-tls" not found Jul 08 17:33:57.964959 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:57.964922 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/84f80313-db9a-4e96-b7e0-41817cd010cd-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-r5djz\" (UID: \"84f80313-db9a-4e96-b7e0-41817cd010cd\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-r5djz" Jul 08 17:33:57.965126 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:57.965072 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 17:33:57.965190 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:57.965144 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84f80313-db9a-4e96-b7e0-41817cd010cd-networking-console-plugin-cert podName:84f80313-db9a-4e96-b7e0-41817cd010cd nodeName:}" failed. No retries permitted until 2026-07-08 17:33:58.965124314 +0000 UTC m=+37.201516546 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/84f80313-db9a-4e96-b7e0-41817cd010cd-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-r5djz" (UID: "84f80313-db9a-4e96-b7e0-41817cd010cd") : secret "networking-console-plugin-cert" not found Jul 08 17:33:58.519833 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:58.519742 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fb5wd" event={"ID":"a9cbbc55-704c-42c5-8ef9-c1847dd931b5","Type":"ContainerStarted","Data":"45cc05260a496794e9968a7cca6740d760fe9e2ed0e8fece6726367b92e31de2"} Jul 08 17:33:58.522344 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:58.522272 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hjp8j" event={"ID":"3e112127-3239-4a4f-b7bd-860ef4225433","Type":"ContainerStarted","Data":"5886abf357c19ead5a74675334c9e6f3ad95d875b6f676c4862c6b920ae504e1"} Jul 08 17:33:58.523867 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:58.523790 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gnjct" event={"ID":"12e2c475-d57a-4902-a4ea-810948c00c4d","Type":"ContainerStarted","Data":"9154760935d35a62b3bd179824aa904b2ed6dfdae9aeda4d37ff2e3e16a684d5"} Jul 08 17:33:58.525742 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:58.525659 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-kkc6p" event={"ID":"be4b19c2-731c-4888-9120-ab3330cd01e9","Type":"ContainerStarted","Data":"f81ea1d3c439ff9ed2f8eade59fe385967a27a41be86bc786f8d894c016b4edb"} Jul 08 17:33:58.530825 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:58.530760 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ngz76" event={"ID":"d5bdfe96-0ab4-4173-90bb-538d09c747d2","Type":"ContainerStarted","Data":"daf0802f10848381a8657cef02998b3b9de47365608be4a37d92d6079357bc2f"} Jul 08 17:33:58.535088 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:58.535025 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-dv6x4" event={"ID":"fc5a9365-5086-4814-b394-cb0cc249d1ff","Type":"ContainerStarted","Data":"80d3c7cd91db6af970ce8e0c1001f76b21d47fbb39858253065b1ff4fe02026c"} Jul 08 17:33:58.537331 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:58.537279 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-mnhqg" event={"ID":"058a4314-4829-4b3d-a275-477b305bcf91","Type":"ContainerStarted","Data":"b9dc320dfb9380e288c576ae115054a8a0c44a4503a2a059c829210d3a26f621"} Jul 08 17:33:58.875646 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:58.875560 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eba717c9-222d-4dcf-a495-4e79977b5a93-service-ca-bundle\") pod \"router-default-cb559779c-fbv6t\" (UID: \"eba717c9-222d-4dcf-a495-4e79977b5a93\") " pod="openshift-ingress/router-default-cb559779c-fbv6t" Jul 08 17:33:58.875830 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:58.875663 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/df5881fe-22be-4a83-a4b4-616788ea2372-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-jbpgz\" (UID: \"df5881fe-22be-4a83-a4b4-616788ea2372\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jbpgz" Jul 08 17:33:58.875830 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:58.875711 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a728e39-6156-4484-91e0-d9fdf3caf22e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vbzn4\" (UID: \"6a728e39-6156-4484-91e0-d9fdf3caf22e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vbzn4" Jul 08 17:33:58.875830 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:58.875743 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb33c2b1-0214-4114-8873-f58efeea8193-metrics-tls\") pod \"dns-default-6nwml\" (UID: \"eb33c2b1-0214-4114-8873-f58efeea8193\") " pod="openshift-dns/dns-default-6nwml" Jul 08 17:33:58.875830 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:58.875774 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-registry-tls\") pod \"image-registry-5c988458c8-vlhfb\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:33:58.876071 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:58.875847 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eba717c9-222d-4dcf-a495-4e79977b5a93-metrics-certs\") pod \"router-default-cb559779c-fbv6t\" (UID: \"eba717c9-222d-4dcf-a495-4e79977b5a93\") " pod="openshift-ingress/router-default-cb559779c-fbv6t" Jul 08 17:33:58.876071 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:58.875987 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 17:33:58.876071 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:58.876049 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eba717c9-222d-4dcf-a495-4e79977b5a93-metrics-certs podName:eba717c9-222d-4dcf-a495-4e79977b5a93 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:00.876031138 +0000 UTC m=+39.112423386 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eba717c9-222d-4dcf-a495-4e79977b5a93-metrics-certs") pod "router-default-cb559779c-fbv6t" (UID: "eba717c9-222d-4dcf-a495-4e79977b5a93") : secret "router-metrics-certs-default" not found Jul 08 17:33:58.876505 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:58.876478 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eba717c9-222d-4dcf-a495-4e79977b5a93-service-ca-bundle podName:eba717c9-222d-4dcf-a495-4e79977b5a93 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:00.876460579 +0000 UTC m=+39.112852834 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/eba717c9-222d-4dcf-a495-4e79977b5a93-service-ca-bundle") pod "router-default-cb559779c-fbv6t" (UID: "eba717c9-222d-4dcf-a495-4e79977b5a93") : configmap references non-existent config key: service-ca.crt Jul 08 17:33:58.876633 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:58.876586 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 17:33:58.876633 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:58.876626 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df5881fe-22be-4a83-a4b4-616788ea2372-samples-operator-tls podName:df5881fe-22be-4a83-a4b4-616788ea2372 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:00.876613492 +0000 UTC m=+39.113005738 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/df5881fe-22be-4a83-a4b4-616788ea2372-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-jbpgz" (UID: "df5881fe-22be-4a83-a4b4-616788ea2372") : secret "samples-operator-tls" not found Jul 08 17:33:58.876755 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:58.876682 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 17:33:58.876755 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:58.876716 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a728e39-6156-4484-91e0-d9fdf3caf22e-cluster-monitoring-operator-tls podName:6a728e39-6156-4484-91e0-d9fdf3caf22e nodeName:}" failed. No retries permitted until 2026-07-08 17:34:00.876705461 +0000 UTC m=+39.113097705 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6a728e39-6156-4484-91e0-d9fdf3caf22e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vbzn4" (UID: "6a728e39-6156-4484-91e0-d9fdf3caf22e") : secret "cluster-monitoring-operator-tls" not found Jul 08 17:33:58.876864 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:58.876766 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:33:58.876864 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:58.876795 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb33c2b1-0214-4114-8873-f58efeea8193-metrics-tls podName:eb33c2b1-0214-4114-8873-f58efeea8193 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:00.876784826 +0000 UTC m=+39.113177071 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eb33c2b1-0214-4114-8873-f58efeea8193-metrics-tls") pod "dns-default-6nwml" (UID: "eb33c2b1-0214-4114-8873-f58efeea8193") : secret "dns-default-metrics-tls" not found Jul 08 17:33:58.876864 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:58.876852 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:33:58.876864 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:58.876863 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c988458c8-vlhfb: secret "image-registry-tls" not found Jul 08 17:33:58.877048 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:58.876901 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-registry-tls podName:d93a5ee1-5553-4ad9-ade1-352ce4a76d06 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:00.876883603 +0000 UTC m=+39.113275847 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-registry-tls") pod "image-registry-5c988458c8-vlhfb" (UID: "d93a5ee1-5553-4ad9-ade1-352ce4a76d06") : secret "image-registry-tls" not found Jul 08 17:33:58.977464 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:33:58.976808 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/84f80313-db9a-4e96-b7e0-41817cd010cd-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-r5djz\" (UID: \"84f80313-db9a-4e96-b7e0-41817cd010cd\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-r5djz" Jul 08 17:33:58.977464 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:58.977053 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 17:33:58.977464 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:33:58.977114 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84f80313-db9a-4e96-b7e0-41817cd010cd-networking-console-plugin-cert podName:84f80313-db9a-4e96-b7e0-41817cd010cd nodeName:}" failed. No retries permitted until 2026-07-08 17:34:00.977100125 +0000 UTC m=+39.213492355 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/84f80313-db9a-4e96-b7e0-41817cd010cd-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-r5djz" (UID: "84f80313-db9a-4e96-b7e0-41817cd010cd") : secret "networking-console-plugin-cert" not found Jul 08 17:34:00.899820 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:00.899777 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eba717c9-222d-4dcf-a495-4e79977b5a93-metrics-certs\") pod \"router-default-cb559779c-fbv6t\" (UID: \"eba717c9-222d-4dcf-a495-4e79977b5a93\") " pod="openshift-ingress/router-default-cb559779c-fbv6t" Jul 08 17:34:00.899820 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:00.899827 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eba717c9-222d-4dcf-a495-4e79977b5a93-service-ca-bundle\") pod \"router-default-cb559779c-fbv6t\" (UID: \"eba717c9-222d-4dcf-a495-4e79977b5a93\") " pod="openshift-ingress/router-default-cb559779c-fbv6t" Jul 08 17:34:00.900367 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:00.899878 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/df5881fe-22be-4a83-a4b4-616788ea2372-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-jbpgz\" (UID: \"df5881fe-22be-4a83-a4b4-616788ea2372\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jbpgz" Jul 08 17:34:00.900367 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:00.899919 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a728e39-6156-4484-91e0-d9fdf3caf22e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vbzn4\" (UID: \"6a728e39-6156-4484-91e0-d9fdf3caf22e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vbzn4" Jul 08 17:34:00.900367 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:00.899943 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 17:34:00.900367 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:00.899954 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb33c2b1-0214-4114-8873-f58efeea8193-metrics-tls\") pod \"dns-default-6nwml\" (UID: \"eb33c2b1-0214-4114-8873-f58efeea8193\") " pod="openshift-dns/dns-default-6nwml" Jul 08 17:34:00.900367 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:00.899983 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-registry-tls\") pod \"image-registry-5c988458c8-vlhfb\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:34:00.900367 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:00.900012 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eba717c9-222d-4dcf-a495-4e79977b5a93-metrics-certs podName:eba717c9-222d-4dcf-a495-4e79977b5a93 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:04.899987528 +0000 UTC m=+43.136379777 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eba717c9-222d-4dcf-a495-4e79977b5a93-metrics-certs") pod "router-default-cb559779c-fbv6t" (UID: "eba717c9-222d-4dcf-a495-4e79977b5a93") : secret "router-metrics-certs-default" not found Jul 08 17:34:00.900367 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:00.900063 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:34:00.900367 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:00.900067 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:34:00.900367 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:00.900069 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 17:34:00.900367 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:00.900067 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 17:34:00.900367 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:00.900095 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eba717c9-222d-4dcf-a495-4e79977b5a93-service-ca-bundle podName:eba717c9-222d-4dcf-a495-4e79977b5a93 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:04.900082869 +0000 UTC m=+43.136475101 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/eba717c9-222d-4dcf-a495-4e79977b5a93-service-ca-bundle") pod "router-default-cb559779c-fbv6t" (UID: "eba717c9-222d-4dcf-a495-4e79977b5a93") : configmap references non-existent config key: service-ca.crt Jul 08 17:34:00.900367 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:00.900085 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c988458c8-vlhfb: secret "image-registry-tls" not found Jul 08 17:34:00.900367 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:00.900120 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a728e39-6156-4484-91e0-d9fdf3caf22e-cluster-monitoring-operator-tls podName:6a728e39-6156-4484-91e0-d9fdf3caf22e nodeName:}" failed. No retries permitted until 2026-07-08 17:34:04.900110276 +0000 UTC m=+43.136502529 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6a728e39-6156-4484-91e0-d9fdf3caf22e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vbzn4" (UID: "6a728e39-6156-4484-91e0-d9fdf3caf22e") : secret "cluster-monitoring-operator-tls" not found Jul 08 17:34:00.900367 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:00.900137 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb33c2b1-0214-4114-8873-f58efeea8193-metrics-tls podName:eb33c2b1-0214-4114-8873-f58efeea8193 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:04.900128874 +0000 UTC m=+43.136521108 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eb33c2b1-0214-4114-8873-f58efeea8193-metrics-tls") pod "dns-default-6nwml" (UID: "eb33c2b1-0214-4114-8873-f58efeea8193") : secret "dns-default-metrics-tls" not found Jul 08 17:34:00.900367 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:00.900152 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df5881fe-22be-4a83-a4b4-616788ea2372-samples-operator-tls podName:df5881fe-22be-4a83-a4b4-616788ea2372 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:04.90014443 +0000 UTC m=+43.136536660 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/df5881fe-22be-4a83-a4b4-616788ea2372-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-jbpgz" (UID: "df5881fe-22be-4a83-a4b4-616788ea2372") : secret "samples-operator-tls" not found Jul 08 17:34:00.900844 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:00.900170 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-registry-tls podName:d93a5ee1-5553-4ad9-ade1-352ce4a76d06 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:04.90016264 +0000 UTC m=+43.136554871 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-registry-tls") pod "image-registry-5c988458c8-vlhfb" (UID: "d93a5ee1-5553-4ad9-ade1-352ce4a76d06") : secret "image-registry-tls" not found Jul 08 17:34:01.001168 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:01.001128 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/84f80313-db9a-4e96-b7e0-41817cd010cd-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-r5djz\" (UID: \"84f80313-db9a-4e96-b7e0-41817cd010cd\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-r5djz" Jul 08 17:34:01.001340 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:01.001299 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 17:34:01.001400 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:01.001385 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84f80313-db9a-4e96-b7e0-41817cd010cd-networking-console-plugin-cert podName:84f80313-db9a-4e96-b7e0-41817cd010cd nodeName:}" failed. No retries permitted until 2026-07-08 17:34:05.001364073 +0000 UTC m=+43.237756325 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/84f80313-db9a-4e96-b7e0-41817cd010cd-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-r5djz" (UID: "84f80313-db9a-4e96-b7e0-41817cd010cd") : secret "networking-console-plugin-cert" not found Jul 08 17:34:01.720160 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:01.720118 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:01.804803 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:01.804772 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:04.937628 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:04.937589 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eba717c9-222d-4dcf-a495-4e79977b5a93-service-ca-bundle\") pod \"router-default-cb559779c-fbv6t\" (UID: \"eba717c9-222d-4dcf-a495-4e79977b5a93\") " pod="openshift-ingress/router-default-cb559779c-fbv6t" Jul 08 17:34:04.938143 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:04.937661 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/df5881fe-22be-4a83-a4b4-616788ea2372-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-jbpgz\" (UID: \"df5881fe-22be-4a83-a4b4-616788ea2372\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jbpgz" Jul 08 17:34:04.938143 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:04.937709 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a728e39-6156-4484-91e0-d9fdf3caf22e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vbzn4\" (UID: \"6a728e39-6156-4484-91e0-d9fdf3caf22e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vbzn4" Jul 08 17:34:04.938143 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:04.937741 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb33c2b1-0214-4114-8873-f58efeea8193-metrics-tls\") pod \"dns-default-6nwml\" (UID: \"eb33c2b1-0214-4114-8873-f58efeea8193\") " pod="openshift-dns/dns-default-6nwml" Jul 08 17:34:04.938143 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:04.937772 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eba717c9-222d-4dcf-a495-4e79977b5a93-service-ca-bundle podName:eba717c9-222d-4dcf-a495-4e79977b5a93 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:12.937752142 +0000 UTC m=+51.174144392 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/eba717c9-222d-4dcf-a495-4e79977b5a93-service-ca-bundle") pod "router-default-cb559779c-fbv6t" (UID: "eba717c9-222d-4dcf-a495-4e79977b5a93") : configmap references non-existent config key: service-ca.crt Jul 08 17:34:04.938143 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:04.937802 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 17:34:04.938143 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:04.937822 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:34:04.938143 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:04.937810 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-registry-tls\") pod \"image-registry-5c988458c8-vlhfb\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:34:04.938143 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:04.937857 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb33c2b1-0214-4114-8873-f58efeea8193-metrics-tls podName:eb33c2b1-0214-4114-8873-f58efeea8193 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:12.93784738 +0000 UTC m=+51.174239614 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eb33c2b1-0214-4114-8873-f58efeea8193-metrics-tls") pod "dns-default-6nwml" (UID: "eb33c2b1-0214-4114-8873-f58efeea8193") : secret "dns-default-metrics-tls" not found Jul 08 17:34:04.938143 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:04.937872 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:34:04.938143 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:04.937885 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c988458c8-vlhfb: secret "image-registry-tls" not found Jul 08 17:34:04.938143 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:04.937911 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 17:34:04.938143 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:04.937926 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df5881fe-22be-4a83-a4b4-616788ea2372-samples-operator-tls podName:df5881fe-22be-4a83-a4b4-616788ea2372 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:12.93791541 +0000 UTC m=+51.174307642 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/df5881fe-22be-4a83-a4b4-616788ea2372-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-jbpgz" (UID: "df5881fe-22be-4a83-a4b4-616788ea2372") : secret "samples-operator-tls" not found Jul 08 17:34:04.938143 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:04.937945 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-registry-tls podName:d93a5ee1-5553-4ad9-ade1-352ce4a76d06 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:12.937934493 +0000 UTC m=+51.174326725 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-registry-tls") pod "image-registry-5c988458c8-vlhfb" (UID: "d93a5ee1-5553-4ad9-ade1-352ce4a76d06") : secret "image-registry-tls" not found Jul 08 17:34:04.938143 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:04.937965 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a728e39-6156-4484-91e0-d9fdf3caf22e-cluster-monitoring-operator-tls podName:6a728e39-6156-4484-91e0-d9fdf3caf22e nodeName:}" failed. No retries permitted until 2026-07-08 17:34:12.937955192 +0000 UTC m=+51.174347425 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6a728e39-6156-4484-91e0-d9fdf3caf22e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vbzn4" (UID: "6a728e39-6156-4484-91e0-d9fdf3caf22e") : secret "cluster-monitoring-operator-tls" not found Jul 08 17:34:04.938143 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:04.938035 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eba717c9-222d-4dcf-a495-4e79977b5a93-metrics-certs\") pod \"router-default-cb559779c-fbv6t\" (UID: \"eba717c9-222d-4dcf-a495-4e79977b5a93\") " pod="openshift-ingress/router-default-cb559779c-fbv6t" Jul 08 17:34:04.938143 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:04.938128 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 17:34:04.938777 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:04.938154 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eba717c9-222d-4dcf-a495-4e79977b5a93-metrics-certs podName:eba717c9-222d-4dcf-a495-4e79977b5a93 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:12.938144067 +0000 UTC m=+51.174536297 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eba717c9-222d-4dcf-a495-4e79977b5a93-metrics-certs") pod "router-default-cb559779c-fbv6t" (UID: "eba717c9-222d-4dcf-a495-4e79977b5a93") : secret "router-metrics-certs-default" not found Jul 08 17:34:05.038591 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:05.038531 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/84f80313-db9a-4e96-b7e0-41817cd010cd-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-r5djz\" (UID: \"84f80313-db9a-4e96-b7e0-41817cd010cd\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-r5djz" Jul 08 17:34:05.038778 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:05.038679 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 17:34:05.038778 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:05.038740 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84f80313-db9a-4e96-b7e0-41817cd010cd-networking-console-plugin-cert podName:84f80313-db9a-4e96-b7e0-41817cd010cd nodeName:}" failed. No retries permitted until 2026-07-08 17:34:13.038723151 +0000 UTC m=+51.275115386 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/84f80313-db9a-4e96-b7e0-41817cd010cd-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-r5djz" (UID: "84f80313-db9a-4e96-b7e0-41817cd010cd") : secret "networking-console-plugin-cert" not found Jul 08 17:34:08.568354 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:08.568318 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fb5wd" event={"ID":"a9cbbc55-704c-42c5-8ef9-c1847dd931b5","Type":"ContainerStarted","Data":"ab58271e4ccc42c18b759c3589fbd0c78c31826c21d0a3da3472d6e9ee80c0ce"} Jul 08 17:34:08.570019 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:08.569988 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hjp8j" event={"ID":"3e112127-3239-4a4f-b7bd-860ef4225433","Type":"ContainerStarted","Data":"bc2626c42c1c8905b15f5696f4bac85444551c173099c0d36477924cb58b86c4"} Jul 08 17:34:08.571682 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:08.571629 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gnjct" event={"ID":"12e2c475-d57a-4902-a4ea-810948c00c4d","Type":"ContainerStarted","Data":"59d6284efa9935b352272e6ff802d9201c7098998ac30816219fab6c17a33d00"} Jul 08 17:34:08.573718 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:08.573693 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-kkc6p" event={"ID":"be4b19c2-731c-4888-9120-ab3330cd01e9","Type":"ContainerStarted","Data":"4527e58f761b88c4601ace5a7b03a22f778ae35649ae84dcd209dfafb411516f"} Jul 08 17:34:08.575314 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:08.575287 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ngz76" event={"ID":"d5bdfe96-0ab4-4173-90bb-538d09c747d2","Type":"ContainerStarted","Data":"afdbe9aa8aaaa29a4f1ba99d7355a56f71da45338c18c3605a9b82a1a6539413"} Jul 08 17:34:08.578391 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:08.578370 2552 generic.go:356] "Generic (PLEG): container finished" podID="3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa" containerID="840006100dbd4bcb89b1ed0f3457b272290389526e38e0ab463c27af094192c5" exitCode=0 Jul 08 17:34:08.578470 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:08.578432 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvhnq" event={"ID":"3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa","Type":"ContainerDied","Data":"840006100dbd4bcb89b1ed0f3457b272290389526e38e0ab463c27af094192c5"} Jul 08 17:34:08.584350 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:08.584321 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-dv6x4" event={"ID":"fc5a9365-5086-4814-b394-cb0cc249d1ff","Type":"ContainerStarted","Data":"57cf4336235d07ab08e5f0c0d4c29c8ba85693c9dc81d046d0697a1921d96596"} Jul 08 17:34:08.586666 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:08.586619 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fb5wd" podStartSLOduration=28.833377855 podStartE2EDuration="38.586600512s" totalImagesPullingTime="9.753222657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:33:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:34:08.585144439 +0000 UTC m=+46.821536695" watchObservedRunningTime="2026-07-08 17:34:08.586600512 +0000 UTC m=+46.822992770" Jul 08 17:34:08.589853 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:08.589833 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-mnhqg_058a4314-4829-4b3d-a275-477b305bcf91/console-operator/0.log" Jul 08 17:34:08.589960 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:08.589874 2552 generic.go:356] "Generic (PLEG): container finished" podID="058a4314-4829-4b3d-a275-477b305bcf91" containerID="c3b5b84f6ad4a62aea09d87369a8c1292d544fefbd08b3b0998abb1898ee7f00" exitCode=255 Jul 08 17:34:08.589960 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:08.589909 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-mnhqg" event={"ID":"058a4314-4829-4b3d-a275-477b305bcf91","Type":"ContainerDied","Data":"c3b5b84f6ad4a62aea09d87369a8c1292d544fefbd08b3b0998abb1898ee7f00"} Jul 08 17:34:08.590186 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:08.590154 2552 scope.go:117] "RemoveContainer" containerID="c3b5b84f6ad4a62aea09d87369a8c1292d544fefbd08b3b0998abb1898ee7f00" Jul 08 17:34:08.601747 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:08.601694 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-hjp8j" podStartSLOduration=29.773489686 podStartE2EDuration="39.601663481s" totalImagesPullingTime="9.828173795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:33:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:34:08.601245135 +0000 UTC m=+46.837637389" watchObservedRunningTime="2026-07-08 17:34:08.601663481 +0000 UTC m=+46.838055924" Jul 08 17:34:08.623672 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:08.621074 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gnjct" podStartSLOduration=29.848348883 podStartE2EDuration="39.621057913s" totalImagesPullingTime="9.77270903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:33:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:34:08.620486437 +0000 UTC m=+46.856878692" watchObservedRunningTime="2026-07-08 17:34:08.621057913 +0000 UTC m=+46.857450167" Jul 08 17:34:08.645634 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:08.644464 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-dv6x4" podStartSLOduration=20.922716773 podStartE2EDuration="30.644446167s" totalImagesPullingTime="9.721729394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:33:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:34:08.643848532 +0000 UTC m=+46.880240787" watchObservedRunningTime="2026-07-08 17:34:08.644446167 +0000 UTC m=+46.880838425" Jul 08 17:34:08.694833 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:08.694768 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ngz76" podStartSLOduration=1.971082352 podStartE2EDuration="11.69474712s" totalImagesPullingTime="9.723664768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:33:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:34:08.693186557 +0000 UTC m=+46.929578816" watchObservedRunningTime="2026-07-08 17:34:08.69474712 +0000 UTC m=+46.931139374" Jul 08 17:34:08.719223 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:08.719067 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:08.750561 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:08.750337 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-kkc6p" podStartSLOduration=29.866889683 podStartE2EDuration="39.750320073s" totalImagesPullingTime="9.88343039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:33:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:34:08.718084587 +0000 UTC m=+46.954476840" watchObservedRunningTime="2026-07-08 17:34:08.750320073 +0000 UTC m=+46.986712340" Jul 08 17:34:09.405245 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:09.405209 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:09.535953 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:09.535920 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lcl76"] Jul 08 17:34:09.557776 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:09.557746 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lcl76" Jul 08 17:34:09.558172 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:09.558144 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lcl76"] Jul 08 17:34:09.560771 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:09.560749 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 08 17:34:09.561459 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:09.561437 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mm4vx\"" Jul 08 17:34:09.561688 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:09.561673 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 08 17:34:09.581991 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:09.581967 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c85077e5-ea69-4b35-ae77-eaca46d27586-crio-socket\") pod \"insights-runtime-extractor-lcl76\" (UID: \"c85077e5-ea69-4b35-ae77-eaca46d27586\") " pod="openshift-insights/insights-runtime-extractor-lcl76" Jul 08 17:34:09.582279 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:09.581996 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c85077e5-ea69-4b35-ae77-eaca46d27586-data-volume\") pod \"insights-runtime-extractor-lcl76\" (UID: \"c85077e5-ea69-4b35-ae77-eaca46d27586\") " pod="openshift-insights/insights-runtime-extractor-lcl76" Jul 08 17:34:09.582279 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:09.582012 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c85077e5-ea69-4b35-ae77-eaca46d27586-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lcl76\" (UID: \"c85077e5-ea69-4b35-ae77-eaca46d27586\") " pod="openshift-insights/insights-runtime-extractor-lcl76" Jul 08 17:34:09.582279 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:09.582072 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46829\" (UniqueName: \"kubernetes.io/projected/c85077e5-ea69-4b35-ae77-eaca46d27586-kube-api-access-46829\") pod \"insights-runtime-extractor-lcl76\" (UID: \"c85077e5-ea69-4b35-ae77-eaca46d27586\") " pod="openshift-insights/insights-runtime-extractor-lcl76" Jul 08 17:34:09.582279 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:09.582150 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c85077e5-ea69-4b35-ae77-eaca46d27586-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lcl76\" (UID: \"c85077e5-ea69-4b35-ae77-eaca46d27586\") " pod="openshift-insights/insights-runtime-extractor-lcl76" Jul 08 17:34:09.598683 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:09.598658 2552 generic.go:356] "Generic (PLEG): container finished" podID="3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa" containerID="ea71fa8d93c08bc8f54c56cf7cf565c26843eb6979467273357320c6b7b896fe" exitCode=0 Jul 08 17:34:09.598786 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:09.598740 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvhnq" event={"ID":"3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa","Type":"ContainerDied","Data":"ea71fa8d93c08bc8f54c56cf7cf565c26843eb6979467273357320c6b7b896fe"} Jul 08 17:34:09.600356 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:09.600255 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-mnhqg_058a4314-4829-4b3d-a275-477b305bcf91/console-operator/1.log" Jul 08 17:34:09.600715 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:09.600700 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-mnhqg_058a4314-4829-4b3d-a275-477b305bcf91/console-operator/0.log" Jul 08 17:34:09.600784 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:09.600734 2552 generic.go:356] "Generic (PLEG): container finished" podID="058a4314-4829-4b3d-a275-477b305bcf91" containerID="afe390545e3d119d63cd98a56be60b933343e9fa6c4f003759f438229f0056e1" exitCode=255 Jul 08 17:34:09.600833 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:09.600796 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-mnhqg" event={"ID":"058a4314-4829-4b3d-a275-477b305bcf91","Type":"ContainerDied","Data":"afe390545e3d119d63cd98a56be60b933343e9fa6c4f003759f438229f0056e1"} Jul 08 17:34:09.600892 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:09.600852 2552 scope.go:117] "RemoveContainer" containerID="c3b5b84f6ad4a62aea09d87369a8c1292d544fefbd08b3b0998abb1898ee7f00" Jul 08 17:34:09.601044 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:09.601026 2552 scope.go:117] "RemoveContainer" containerID="afe390545e3d119d63cd98a56be60b933343e9fa6c4f003759f438229f0056e1" Jul 08 17:34:09.601202 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:09.601182 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-mnhqg_openshift-console-operator(058a4314-4829-4b3d-a275-477b305bcf91)\"" pod="openshift-console-operator/console-operator-68b757fb67-mnhqg" podUID="058a4314-4829-4b3d-a275-477b305bcf91" Jul 08 17:34:09.684281 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:09.683972 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c85077e5-ea69-4b35-ae77-eaca46d27586-crio-socket\") pod \"insights-runtime-extractor-lcl76\" (UID: \"c85077e5-ea69-4b35-ae77-eaca46d27586\") " pod="openshift-insights/insights-runtime-extractor-lcl76" Jul 08 17:34:09.684281 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:09.684049 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c85077e5-ea69-4b35-ae77-eaca46d27586-data-volume\") pod \"insights-runtime-extractor-lcl76\" (UID: \"c85077e5-ea69-4b35-ae77-eaca46d27586\") " pod="openshift-insights/insights-runtime-extractor-lcl76" Jul 08 17:34:09.684281 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:09.684049 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c85077e5-ea69-4b35-ae77-eaca46d27586-crio-socket\") pod \"insights-runtime-extractor-lcl76\" (UID: \"c85077e5-ea69-4b35-ae77-eaca46d27586\") " pod="openshift-insights/insights-runtime-extractor-lcl76" Jul 08 17:34:09.684281 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:09.684078 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c85077e5-ea69-4b35-ae77-eaca46d27586-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lcl76\" (UID: \"c85077e5-ea69-4b35-ae77-eaca46d27586\") " pod="openshift-insights/insights-runtime-extractor-lcl76" Jul 08 17:34:09.684624 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:09.684293 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 17:34:09.684624 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:09.684360 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c85077e5-ea69-4b35-ae77-eaca46d27586-insights-runtime-extractor-tls podName:c85077e5-ea69-4b35-ae77-eaca46d27586 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:10.184346158 +0000 UTC m=+48.420738390 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c85077e5-ea69-4b35-ae77-eaca46d27586-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lcl76" (UID: "c85077e5-ea69-4b35-ae77-eaca46d27586") : secret "insights-runtime-extractor-tls" not found Jul 08 17:34:09.684624 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:09.684376 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46829\" (UniqueName: \"kubernetes.io/projected/c85077e5-ea69-4b35-ae77-eaca46d27586-kube-api-access-46829\") pod \"insights-runtime-extractor-lcl76\" (UID: \"c85077e5-ea69-4b35-ae77-eaca46d27586\") " pod="openshift-insights/insights-runtime-extractor-lcl76" Jul 08 17:34:09.684624 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:09.684426 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c85077e5-ea69-4b35-ae77-eaca46d27586-data-volume\") pod \"insights-runtime-extractor-lcl76\" (UID: \"c85077e5-ea69-4b35-ae77-eaca46d27586\") " pod="openshift-insights/insights-runtime-extractor-lcl76" Jul 08 17:34:09.684624 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:09.684437 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c85077e5-ea69-4b35-ae77-eaca46d27586-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lcl76\" (UID: \"c85077e5-ea69-4b35-ae77-eaca46d27586\") " pod="openshift-insights/insights-runtime-extractor-lcl76" Jul 08 17:34:09.684624 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:09.684482 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 17:34:09.684624 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:09.684506 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c85077e5-ea69-4b35-ae77-eaca46d27586-kube-rbac-proxy-cm podName:c85077e5-ea69-4b35-ae77-eaca46d27586 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:10.184498238 +0000 UTC m=+48.420890468 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c85077e5-ea69-4b35-ae77-eaca46d27586-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lcl76" (UID: "c85077e5-ea69-4b35-ae77-eaca46d27586") : configmap "kube-rbac-proxy" not found Jul 08 17:34:09.694522 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:09.694497 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46829\" (UniqueName: \"kubernetes.io/projected/c85077e5-ea69-4b35-ae77-eaca46d27586-kube-api-access-46829\") pod \"insights-runtime-extractor-lcl76\" (UID: \"c85077e5-ea69-4b35-ae77-eaca46d27586\") " pod="openshift-insights/insights-runtime-extractor-lcl76" Jul 08 17:34:09.795573 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:09.795532 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:10.188457 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:10.188425 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c85077e5-ea69-4b35-ae77-eaca46d27586-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lcl76\" (UID: \"c85077e5-ea69-4b35-ae77-eaca46d27586\") " pod="openshift-insights/insights-runtime-extractor-lcl76" Jul 08 17:34:10.188665 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:10.188488 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c85077e5-ea69-4b35-ae77-eaca46d27586-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lcl76\" (UID: \"c85077e5-ea69-4b35-ae77-eaca46d27586\") " pod="openshift-insights/insights-runtime-extractor-lcl76" Jul 08 17:34:10.188665 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:10.188567 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 17:34:10.188665 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:10.188598 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 17:34:10.188665 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:10.188619 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c85077e5-ea69-4b35-ae77-eaca46d27586-kube-rbac-proxy-cm podName:c85077e5-ea69-4b35-ae77-eaca46d27586 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:11.188604405 +0000 UTC m=+49.424996636 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c85077e5-ea69-4b35-ae77-eaca46d27586-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lcl76" (UID: "c85077e5-ea69-4b35-ae77-eaca46d27586") : configmap "kube-rbac-proxy" not found Jul 08 17:34:10.188665 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:10.188648 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c85077e5-ea69-4b35-ae77-eaca46d27586-insights-runtime-extractor-tls podName:c85077e5-ea69-4b35-ae77-eaca46d27586 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:11.188635822 +0000 UTC m=+49.425028053 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c85077e5-ea69-4b35-ae77-eaca46d27586-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lcl76" (UID: "c85077e5-ea69-4b35-ae77-eaca46d27586") : secret "insights-runtime-extractor-tls" not found Jul 08 17:34:10.609277 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:10.609238 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvhnq" event={"ID":"3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa","Type":"ContainerStarted","Data":"88b1e0a880e7c2fa4c922e64d50e9f24928ed5a7c3c2c30847ff12daabbfc942"} Jul 08 17:34:10.610651 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:10.610630 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-mnhqg_058a4314-4829-4b3d-a275-477b305bcf91/console-operator/1.log" Jul 08 17:34:10.610908 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:10.610894 2552 scope.go:117] "RemoveContainer" containerID="afe390545e3d119d63cd98a56be60b933343e9fa6c4f003759f438229f0056e1" Jul 08 17:34:10.611042 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:10.611027 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-mnhqg_openshift-console-operator(058a4314-4829-4b3d-a275-477b305bcf91)\"" pod="openshift-console-operator/console-operator-68b757fb67-mnhqg" podUID="058a4314-4829-4b3d-a275-477b305bcf91" Jul 08 17:34:10.629963 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:10.629943 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:10.641341 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:10.641299 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pvhnq" podStartSLOduration=9.083029466 podStartE2EDuration="48.641286061s" totalImagesPullingTime="39.558256595s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:33:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:34:10.640748826 +0000 UTC m=+48.877141079" watchObservedRunningTime="2026-07-08 17:34:10.641286061 +0000 UTC m=+48.877678314" Jul 08 17:34:10.732512 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:10.732476 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:10.835946 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:10.835917 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:10.959374 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:10.959317 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:11.056687 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:11.056654 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:11.197228 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:11.197194 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c85077e5-ea69-4b35-ae77-eaca46d27586-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lcl76\" (UID: \"c85077e5-ea69-4b35-ae77-eaca46d27586\") " pod="openshift-insights/insights-runtime-extractor-lcl76" Jul 08 17:34:11.197390 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:11.197267 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c85077e5-ea69-4b35-ae77-eaca46d27586-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lcl76\" (UID: \"c85077e5-ea69-4b35-ae77-eaca46d27586\") " pod="openshift-insights/insights-runtime-extractor-lcl76" Jul 08 17:34:11.197390 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:11.197358 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 17:34:11.197390 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:11.197363 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 17:34:11.197479 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:11.197428 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c85077e5-ea69-4b35-ae77-eaca46d27586-insights-runtime-extractor-tls podName:c85077e5-ea69-4b35-ae77-eaca46d27586 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:13.197410401 +0000 UTC m=+51.433802634 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c85077e5-ea69-4b35-ae77-eaca46d27586-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lcl76" (UID: "c85077e5-ea69-4b35-ae77-eaca46d27586") : secret "insights-runtime-extractor-tls" not found Jul 08 17:34:11.197479 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:11.197446 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c85077e5-ea69-4b35-ae77-eaca46d27586-kube-rbac-proxy-cm podName:c85077e5-ea69-4b35-ae77-eaca46d27586 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:13.197438333 +0000 UTC m=+51.433830566 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c85077e5-ea69-4b35-ae77-eaca46d27586-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lcl76" (UID: "c85077e5-ea69-4b35-ae77-eaca46d27586") : configmap "kube-rbac-proxy" not found Jul 08 17:34:11.896892 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:11.896853 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:11.966133 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:11.966089 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:12.260232 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:12.260208 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xbmdk_dfc4b46e-2008-40ce-b409-796fd7178d10/dns-node-resolver/0.log" Jul 08 17:34:12.497813 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:12.497765 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:12.559469 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:12.559402 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:13.015039 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:13.014990 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eba717c9-222d-4dcf-a495-4e79977b5a93-metrics-certs\") pod \"router-default-cb559779c-fbv6t\" (UID: \"eba717c9-222d-4dcf-a495-4e79977b5a93\") " pod="openshift-ingress/router-default-cb559779c-fbv6t" Jul 08 17:34:13.015516 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:13.015053 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eba717c9-222d-4dcf-a495-4e79977b5a93-service-ca-bundle\") pod \"router-default-cb559779c-fbv6t\" (UID: \"eba717c9-222d-4dcf-a495-4e79977b5a93\") " pod="openshift-ingress/router-default-cb559779c-fbv6t" Jul 08 17:34:13.015516 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:13.015125 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/df5881fe-22be-4a83-a4b4-616788ea2372-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-jbpgz\" (UID: \"df5881fe-22be-4a83-a4b4-616788ea2372\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jbpgz" Jul 08 17:34:13.015516 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:13.015166 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a728e39-6156-4484-91e0-d9fdf3caf22e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vbzn4\" (UID: \"6a728e39-6156-4484-91e0-d9fdf3caf22e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vbzn4" Jul 08 17:34:13.015516 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:13.015166 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:13.015516 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:13.015189 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb33c2b1-0214-4114-8873-f58efeea8193-metrics-tls\") pod \"dns-default-6nwml\" (UID: \"eb33c2b1-0214-4114-8873-f58efeea8193\") " pod="openshift-dns/dns-default-6nwml" Jul 08 17:34:13.015516 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:13.015213 2552 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 08 17:34:13.015516 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:13.015223 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-registry-tls\") pod \"image-registry-5c988458c8-vlhfb\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:34:13.015516 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:13.015290 2552 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 08 17:34:13.015516 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:13.015335 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 17:34:13.015516 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:13.015335 2552 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 08 17:34:13.015516 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:13.015293 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/eba717c9-222d-4dcf-a495-4e79977b5a93-service-ca-bundle podName:eba717c9-222d-4dcf-a495-4e79977b5a93 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:29.015271254 +0000 UTC m=+67.251663502 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/eba717c9-222d-4dcf-a495-4e79977b5a93-service-ca-bundle") pod "router-default-cb559779c-fbv6t" (UID: "eba717c9-222d-4dcf-a495-4e79977b5a93") : configmap references non-existent config key: service-ca.crt Jul 08 17:34:13.015516 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:13.015350 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c988458c8-vlhfb: secret "image-registry-tls" not found Jul 08 17:34:13.015516 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:13.015371 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eba717c9-222d-4dcf-a495-4e79977b5a93-metrics-certs podName:eba717c9-222d-4dcf-a495-4e79977b5a93 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:29.015356241 +0000 UTC m=+67.251748477 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eba717c9-222d-4dcf-a495-4e79977b5a93-metrics-certs") pod "router-default-cb559779c-fbv6t" (UID: "eba717c9-222d-4dcf-a495-4e79977b5a93") : secret "router-metrics-certs-default" not found Jul 08 17:34:13.015516 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:13.015389 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df5881fe-22be-4a83-a4b4-616788ea2372-samples-operator-tls podName:df5881fe-22be-4a83-a4b4-616788ea2372 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:29.015379131 +0000 UTC m=+67.251771374 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/df5881fe-22be-4a83-a4b4-616788ea2372-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-jbpgz" (UID: "df5881fe-22be-4a83-a4b4-616788ea2372") : secret "samples-operator-tls" not found Jul 08 17:34:13.015516 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:13.015337 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 17:34:13.015516 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:13.015411 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a728e39-6156-4484-91e0-d9fdf3caf22e-cluster-monitoring-operator-tls podName:6a728e39-6156-4484-91e0-d9fdf3caf22e nodeName:}" failed. No retries permitted until 2026-07-08 17:34:29.015396119 +0000 UTC m=+67.251788369 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6a728e39-6156-4484-91e0-d9fdf3caf22e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-vbzn4" (UID: "6a728e39-6156-4484-91e0-d9fdf3caf22e") : secret "cluster-monitoring-operator-tls" not found Jul 08 17:34:13.016154 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:13.015428 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-registry-tls podName:d93a5ee1-5553-4ad9-ade1-352ce4a76d06 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:29.015421253 +0000 UTC m=+67.251813484 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-registry-tls") pod "image-registry-5c988458c8-vlhfb" (UID: "d93a5ee1-5553-4ad9-ade1-352ce4a76d06") : secret "image-registry-tls" not found Jul 08 17:34:13.016154 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:13.015438 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb33c2b1-0214-4114-8873-f58efeea8193-metrics-tls podName:eb33c2b1-0214-4114-8873-f58efeea8193 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:29.015432579 +0000 UTC m=+67.251824810 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/eb33c2b1-0214-4114-8873-f58efeea8193-metrics-tls") pod "dns-default-6nwml" (UID: "eb33c2b1-0214-4114-8873-f58efeea8193") : secret "dns-default-metrics-tls" not found Jul 08 17:34:13.115303 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:13.115266 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:13.115559 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:13.115527 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/84f80313-db9a-4e96-b7e0-41817cd010cd-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-r5djz\" (UID: \"84f80313-db9a-4e96-b7e0-41817cd010cd\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-r5djz" Jul 08 17:34:13.115689 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:13.115653 2552 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 17:34:13.115729 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:13.115706 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84f80313-db9a-4e96-b7e0-41817cd010cd-networking-console-plugin-cert podName:84f80313-db9a-4e96-b7e0-41817cd010cd nodeName:}" failed. No retries permitted until 2026-07-08 17:34:29.115691751 +0000 UTC m=+67.352083982 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/84f80313-db9a-4e96-b7e0-41817cd010cd-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-r5djz" (UID: "84f80313-db9a-4e96-b7e0-41817cd010cd") : secret "networking-console-plugin-cert" not found Jul 08 17:34:13.216194 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:13.216159 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c85077e5-ea69-4b35-ae77-eaca46d27586-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lcl76\" (UID: \"c85077e5-ea69-4b35-ae77-eaca46d27586\") " pod="openshift-insights/insights-runtime-extractor-lcl76" Jul 08 17:34:13.216420 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:13.216219 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c85077e5-ea69-4b35-ae77-eaca46d27586-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lcl76\" (UID: \"c85077e5-ea69-4b35-ae77-eaca46d27586\") " pod="openshift-insights/insights-runtime-extractor-lcl76" Jul 08 17:34:13.216420 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:13.216335 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 17:34:13.216420 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:13.216398 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c85077e5-ea69-4b35-ae77-eaca46d27586-insights-runtime-extractor-tls podName:c85077e5-ea69-4b35-ae77-eaca46d27586 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:17.216383648 +0000 UTC m=+55.452775880 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c85077e5-ea69-4b35-ae77-eaca46d27586-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lcl76" (UID: "c85077e5-ea69-4b35-ae77-eaca46d27586") : secret "insights-runtime-extractor-tls" not found Jul 08 17:34:13.216829 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:13.216809 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c85077e5-ea69-4b35-ae77-eaca46d27586-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lcl76\" (UID: \"c85077e5-ea69-4b35-ae77-eaca46d27586\") " pod="openshift-insights/insights-runtime-extractor-lcl76" Jul 08 17:34:13.217403 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:13.217382 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:13.261281 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:13.261256 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jlll6_e5316994-1495-49ea-a279-808cb77f0f92/node-ca/0.log" Jul 08 17:34:13.484481 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:13.484434 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:14.259913 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:14.259873 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ngz76_d5bdfe96-0ab4-4173-90bb-538d09c747d2/serve-healthcheck-canary/0.log" Jul 08 17:34:14.864431 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:14.864400 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-gnjct_12e2c475-d57a-4902-a4ea-810948c00c4d/kube-storage-version-migrator-operator/0.log" Jul 08 17:34:16.865419 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:16.865382 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:16.998252 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:16.998221 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:17.253524 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:17.253487 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c85077e5-ea69-4b35-ae77-eaca46d27586-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lcl76\" (UID: \"c85077e5-ea69-4b35-ae77-eaca46d27586\") " pod="openshift-insights/insights-runtime-extractor-lcl76" Jul 08 17:34:17.253707 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:17.253616 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 17:34:17.253707 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:17.253671 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c85077e5-ea69-4b35-ae77-eaca46d27586-insights-runtime-extractor-tls podName:c85077e5-ea69-4b35-ae77-eaca46d27586 nodeName:}" failed. No retries permitted until 2026-07-08 17:34:25.253658322 +0000 UTC m=+63.490050554 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c85077e5-ea69-4b35-ae77-eaca46d27586-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lcl76" (UID: "c85077e5-ea69-4b35-ae77-eaca46d27586") : secret "insights-runtime-extractor-tls" not found Jul 08 17:34:17.483557 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:17.483512 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-mnhqg" Jul 08 17:34:17.483713 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:17.483589 2552 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-mnhqg" Jul 08 17:34:17.483918 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:17.483906 2552 scope.go:117] "RemoveContainer" containerID="afe390545e3d119d63cd98a56be60b933343e9fa6c4f003759f438229f0056e1" Jul 08 17:34:17.484059 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:34:17.484044 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-mnhqg_openshift-console-operator(058a4314-4829-4b3d-a275-477b305bcf91)\"" pod="openshift-console-operator/console-operator-68b757fb67-mnhqg" podUID="058a4314-4829-4b3d-a275-477b305bcf91" Jul 08 17:34:17.836358 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:17.836324 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:17.892457 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:17.892422 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:18.368167 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:18.368134 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:18.962298 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:18.962261 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:19.971865 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:19.971833 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:20.044504 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:20.044467 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:20.506022 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:20.505982 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:20.606940 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:20.606916 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:20.976164 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:20.973316 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:21.166479 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:21.166425 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:21.365415 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:21.365314 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:21.509043 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:21.509014 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nnnfl" Jul 08 17:34:22.091997 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:22.091962 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:22.192476 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:22.192438 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:22.376927 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:22.376848 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:23.050353 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:23.050323 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:23.189884 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:23.189830 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:23.306034 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:23.305951 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:23.420323 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:23.420278 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:23.572732 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:23.572634 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:24.561463 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:24.561427 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:24.964303 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:24.964277 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:25.175942 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:25.175911 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:25.311029 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:25.310935 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:25.328189 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:25.328163 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c85077e5-ea69-4b35-ae77-eaca46d27586-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lcl76\" (UID: \"c85077e5-ea69-4b35-ae77-eaca46d27586\") " pod="openshift-insights/insights-runtime-extractor-lcl76" Jul 08 17:34:25.330559 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:25.330524 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c85077e5-ea69-4b35-ae77-eaca46d27586-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lcl76\" (UID: \"c85077e5-ea69-4b35-ae77-eaca46d27586\") " pod="openshift-insights/insights-runtime-extractor-lcl76" Jul 08 17:34:25.411925 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:25.411898 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:25.470768 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:25.470739 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mm4vx\"" Jul 08 17:34:25.478792 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:25.478776 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lcl76" Jul 08 17:34:25.600516 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:25.600496 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lcl76"] Jul 08 17:34:25.602849 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:34:25.602820 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc85077e5_ea69_4b35_ae77_eaca46d27586.slice/crio-f5814d6f42ee50294ca10fd9eb2b9bddb710c0b6a010399fb4609a86e271cd51 WatchSource:0}: Error finding container f5814d6f42ee50294ca10fd9eb2b9bddb710c0b6a010399fb4609a86e271cd51: Status 404 returned error can't find the container with id f5814d6f42ee50294ca10fd9eb2b9bddb710c0b6a010399fb4609a86e271cd51 Jul 08 17:34:25.655365 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:25.655332 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lcl76" event={"ID":"c85077e5-ea69-4b35-ae77-eaca46d27586","Type":"ContainerStarted","Data":"f5814d6f42ee50294ca10fd9eb2b9bddb710c0b6a010399fb4609a86e271cd51"} Jul 08 17:34:25.773477 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:25.773448 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:26.366785 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:26.366754 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:26.970409 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:26.970360 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:27.170900 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:27.170860 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:27.380721 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:27.380641 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:27.958688 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:27.958655 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/309592bc-ee3f-4203-a296-13edbb56a985-original-pull-secret\") pod \"global-pull-secret-syncer-6nt78\" (UID: \"309592bc-ee3f-4203-a296-13edbb56a985\") " pod="kube-system/global-pull-secret-syncer-6nt78" Jul 08 17:34:27.958688 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:27.958693 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d359c83a-ba83-4914-85cc-d2b35b37759c-metrics-certs\") pod \"network-metrics-daemon-xcp9j\" (UID: \"d359c83a-ba83-4914-85cc-d2b35b37759c\") " pod="openshift-multus/network-metrics-daemon-xcp9j" Jul 08 17:34:27.961579 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:27.961556 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 17:34:27.962301 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:27.962276 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 17:34:27.971744 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:27.971720 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/309592bc-ee3f-4203-a296-13edbb56a985-original-pull-secret\") pod \"global-pull-secret-syncer-6nt78\" (UID: \"309592bc-ee3f-4203-a296-13edbb56a985\") " pod="kube-system/global-pull-secret-syncer-6nt78" Jul 08 17:34:27.971744 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:27.971741 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d359c83a-ba83-4914-85cc-d2b35b37759c-metrics-certs\") pod \"network-metrics-daemon-xcp9j\" (UID: \"d359c83a-ba83-4914-85cc-d2b35b37759c\") " pod="openshift-multus/network-metrics-daemon-xcp9j" Jul 08 17:34:28.060008 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:28.059970 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkl7r\" (UniqueName: \"kubernetes.io/projected/78061d5b-da8f-4e57-aabe-71262ec1d1dd-kube-api-access-jkl7r\") pod \"network-check-target-xn2w6\" (UID: \"78061d5b-da8f-4e57-aabe-71262ec1d1dd\") " pod="openshift-network-diagnostics/network-check-target-xn2w6" Jul 08 17:34:28.062841 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:28.062813 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkl7r\" (UniqueName: \"kubernetes.io/projected/78061d5b-da8f-4e57-aabe-71262ec1d1dd-kube-api-access-jkl7r\") pod \"network-check-target-xn2w6\" (UID: \"78061d5b-da8f-4e57-aabe-71262ec1d1dd\") " pod="openshift-network-diagnostics/network-check-target-xn2w6" Jul 08 17:34:28.213063 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:28.212988 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lzq8f\"" Jul 08 17:34:28.217317 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:28.217302 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6nt78" Jul 08 17:34:28.220823 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:28.220798 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xcp9j" Jul 08 17:34:28.223443 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:28.223424 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vntcc\"" Jul 08 17:34:28.231343 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:28.231322 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xn2w6" Jul 08 17:34:28.398394 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:28.398356 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:29.068521 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.068477 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/df5881fe-22be-4a83-a4b4-616788ea2372-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-jbpgz\" (UID: \"df5881fe-22be-4a83-a4b4-616788ea2372\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jbpgz" Jul 08 17:34:29.069096 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.068551 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a728e39-6156-4484-91e0-d9fdf3caf22e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vbzn4\" (UID: \"6a728e39-6156-4484-91e0-d9fdf3caf22e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vbzn4" Jul 08 17:34:29.069096 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.068722 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb33c2b1-0214-4114-8873-f58efeea8193-metrics-tls\") pod \"dns-default-6nwml\" (UID: \"eb33c2b1-0214-4114-8873-f58efeea8193\") " pod="openshift-dns/dns-default-6nwml" Jul 08 17:34:29.069096 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.068765 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-registry-tls\") pod \"image-registry-5c988458c8-vlhfb\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:34:29.069096 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.068850 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eba717c9-222d-4dcf-a495-4e79977b5a93-metrics-certs\") pod \"router-default-cb559779c-fbv6t\" (UID: \"eba717c9-222d-4dcf-a495-4e79977b5a93\") " pod="openshift-ingress/router-default-cb559779c-fbv6t" Jul 08 17:34:29.069096 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.068892 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eba717c9-222d-4dcf-a495-4e79977b5a93-service-ca-bundle\") pod \"router-default-cb559779c-fbv6t\" (UID: \"eba717c9-222d-4dcf-a495-4e79977b5a93\") " pod="openshift-ingress/router-default-cb559779c-fbv6t" Jul 08 17:34:29.069715 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.069686 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eba717c9-222d-4dcf-a495-4e79977b5a93-service-ca-bundle\") pod \"router-default-cb559779c-fbv6t\" (UID: \"eba717c9-222d-4dcf-a495-4e79977b5a93\") " pod="openshift-ingress/router-default-cb559779c-fbv6t" Jul 08 17:34:29.071735 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.071704 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb33c2b1-0214-4114-8873-f58efeea8193-metrics-tls\") pod \"dns-default-6nwml\" (UID: \"eb33c2b1-0214-4114-8873-f58efeea8193\") " pod="openshift-dns/dns-default-6nwml" Jul 08 17:34:29.071842 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.071770 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-registry-tls\") pod \"image-registry-5c988458c8-vlhfb\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:34:29.071842 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.071809 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/df5881fe-22be-4a83-a4b4-616788ea2372-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-jbpgz\" (UID: \"df5881fe-22be-4a83-a4b4-616788ea2372\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jbpgz" Jul 08 17:34:29.072100 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.072078 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eba717c9-222d-4dcf-a495-4e79977b5a93-metrics-certs\") pod \"router-default-cb559779c-fbv6t\" (UID: \"eba717c9-222d-4dcf-a495-4e79977b5a93\") " pod="openshift-ingress/router-default-cb559779c-fbv6t" Jul 08 17:34:29.072741 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.072720 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6a728e39-6156-4484-91e0-d9fdf3caf22e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-vbzn4\" (UID: \"6a728e39-6156-4484-91e0-d9fdf3caf22e\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vbzn4" Jul 08 17:34:29.169559 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.169492 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/84f80313-db9a-4e96-b7e0-41817cd010cd-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-r5djz\" (UID: \"84f80313-db9a-4e96-b7e0-41817cd010cd\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-r5djz" Jul 08 17:34:29.172391 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.172359 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/84f80313-db9a-4e96-b7e0-41817cd010cd-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-r5djz\" (UID: \"84f80313-db9a-4e96-b7e0-41817cd010cd\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-r5djz" Jul 08 17:34:29.267896 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.267647 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-kdzhb\"" Jul 08 17:34:29.272243 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.272223 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vbzn4" Jul 08 17:34:29.278501 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.278458 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5tcwq\"" Jul 08 17:34:29.286841 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.286762 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:34:29.298897 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.298868 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xcp9j"] Jul 08 17:34:29.302190 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:34:29.302159 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd359c83a_ba83_4914_85cc_d2b35b37759c.slice/crio-d9525ce28222b14c37d29adfb7a4c34f140c3cca7d94fd008710ecb48d421b29 WatchSource:0}: Error finding container d9525ce28222b14c37d29adfb7a4c34f140c3cca7d94fd008710ecb48d421b29: Status 404 returned error can't find the container with id d9525ce28222b14c37d29adfb7a4c34f140c3cca7d94fd008710ecb48d421b29 Jul 08 17:34:29.304597 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.304581 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mfr5w\"" Jul 08 17:34:29.311292 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.311267 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5pnx2\"" Jul 08 17:34:29.312263 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.312145 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xn2w6"] Jul 08 17:34:29.312263 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.312197 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-cb559779c-fbv6t" Jul 08 17:34:29.315592 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:34:29.315568 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78061d5b_da8f_4e57_aabe_71262ec1d1dd.slice/crio-4d3beced8ab0d1c437cc12d85d3649fe778b5ca4ecab34bc3e8947646324e64b WatchSource:0}: Error finding container 4d3beced8ab0d1c437cc12d85d3649fe778b5ca4ecab34bc3e8947646324e64b: Status 404 returned error can't find the container with id 4d3beced8ab0d1c437cc12d85d3649fe778b5ca4ecab34bc3e8947646324e64b Jul 08 17:34:29.319637 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.319398 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jbpgz" Jul 08 17:34:29.326885 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.326864 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-99df5\"" Jul 08 17:34:29.331410 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.331143 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6nt78"] Jul 08 17:34:29.339737 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.334791 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6nwml" Jul 08 17:34:29.353698 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.349061 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-cwdjj\"" Jul 08 17:34:29.356459 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.356346 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-r5djz" Jul 08 17:34:29.467028 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.466292 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vbzn4"] Jul 08 17:34:29.492470 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:34:29.486410 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a728e39_6156_4484_91e0_d9fdf3caf22e.slice/crio-80bd14bdd397a744774a1f41c1369c2fe67397528e7de3995c3c61c35866add4 WatchSource:0}: Error finding container 80bd14bdd397a744774a1f41c1369c2fe67397528e7de3995c3c61c35866add4: Status 404 returned error can't find the container with id 80bd14bdd397a744774a1f41c1369c2fe67397528e7de3995c3c61c35866add4 Jul 08 17:34:29.521944 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.521861 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c988458c8-vlhfb"] Jul 08 17:34:29.526271 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:34:29.526237 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd93a5ee1_5553_4ad9_ade1_352ce4a76d06.slice/crio-ffb8fc7362ba01a27d966a2f7c1b1857481a4e456f1abe6faac3ef87382e2ca1 WatchSource:0}: Error finding container ffb8fc7362ba01a27d966a2f7c1b1857481a4e456f1abe6faac3ef87382e2ca1: Status 404 returned error can't find the container with id ffb8fc7362ba01a27d966a2f7c1b1857481a4e456f1abe6faac3ef87382e2ca1 Jul 08 17:34:29.564066 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.564040 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jbpgz"] Jul 08 17:34:29.582267 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.582234 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-cb559779c-fbv6t"] Jul 08 17:34:29.591834 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:34:29.591795 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeba717c9_222d_4dcf_a495_4e79977b5a93.slice/crio-7784e7773eb55dbcc0fc27e685f4cf771362d897c2f477fdd92e1fd999eff86b WatchSource:0}: Error finding container 7784e7773eb55dbcc0fc27e685f4cf771362d897c2f477fdd92e1fd999eff86b: Status 404 returned error can't find the container with id 7784e7773eb55dbcc0fc27e685f4cf771362d897c2f477fdd92e1fd999eff86b Jul 08 17:34:29.602175 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.602152 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6nwml"] Jul 08 17:34:29.604861 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:34:29.604838 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb33c2b1_0214_4114_8873_f58efeea8193.slice/crio-814709a65fe64eede4b46d9af03213d9d15d7a3b4bc470fdfdec381a7c5478c7 WatchSource:0}: Error finding container 814709a65fe64eede4b46d9af03213d9d15d7a3b4bc470fdfdec381a7c5478c7: Status 404 returned error can't find the container with id 814709a65fe64eede4b46d9af03213d9d15d7a3b4bc470fdfdec381a7c5478c7 Jul 08 17:34:29.616772 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.616746 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-r5djz"] Jul 08 17:34:29.623631 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:34:29.623608 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84f80313_db9a_4e96_b7e0_41817cd010cd.slice/crio-6379f4c03c7126a62c1dd4f61f359f4a326a5b6c7bd9e5bc50375ca14ef3a565 WatchSource:0}: Error finding container 6379f4c03c7126a62c1dd4f61f359f4a326a5b6c7bd9e5bc50375ca14ef3a565: Status 404 returned error can't find the container with id 6379f4c03c7126a62c1dd4f61f359f4a326a5b6c7bd9e5bc50375ca14ef3a565 Jul 08 17:34:29.670579 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.670518 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6nwml" event={"ID":"eb33c2b1-0214-4114-8873-f58efeea8193","Type":"ContainerStarted","Data":"814709a65fe64eede4b46d9af03213d9d15d7a3b4bc470fdfdec381a7c5478c7"} Jul 08 17:34:29.672278 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.672238 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xn2w6" event={"ID":"78061d5b-da8f-4e57-aabe-71262ec1d1dd","Type":"ContainerStarted","Data":"92ad74e7d8fb9028714d5e9e18c379f3904c6793303affb32dbbe3b5f7211dcf"} Jul 08 17:34:29.672468 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.672450 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xn2w6" Jul 08 17:34:29.672632 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.672606 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xn2w6" event={"ID":"78061d5b-da8f-4e57-aabe-71262ec1d1dd","Type":"ContainerStarted","Data":"4d3beced8ab0d1c437cc12d85d3649fe778b5ca4ecab34bc3e8947646324e64b"} Jul 08 17:34:29.673822 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.673801 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-cb559779c-fbv6t" event={"ID":"eba717c9-222d-4dcf-a495-4e79977b5a93","Type":"ContainerStarted","Data":"c9fdfd75b69927fc6264b88087203de7bc30e4896b13f728956390a459609b16"} Jul 08 17:34:29.673919 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.673841 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-cb559779c-fbv6t" event={"ID":"eba717c9-222d-4dcf-a495-4e79977b5a93","Type":"ContainerStarted","Data":"7784e7773eb55dbcc0fc27e685f4cf771362d897c2f477fdd92e1fd999eff86b"} Jul 08 17:34:29.675378 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.675325 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" event={"ID":"d93a5ee1-5553-4ad9-ade1-352ce4a76d06","Type":"ContainerStarted","Data":"d1d7359a4183fa031ff3228ea7792c58d5e69c0a24a5c15832644ed88d002f6c"} Jul 08 17:34:29.675378 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.675366 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" event={"ID":"d93a5ee1-5553-4ad9-ade1-352ce4a76d06","Type":"ContainerStarted","Data":"ffb8fc7362ba01a27d966a2f7c1b1857481a4e456f1abe6faac3ef87382e2ca1"} Jul 08 17:34:29.675521 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.675389 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:34:29.676661 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.676615 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6nt78" event={"ID":"309592bc-ee3f-4203-a296-13edbb56a985","Type":"ContainerStarted","Data":"c6fbacd6816b2cd7bd1bea6425e41c0b4b61ce02f5a943afdf964d3754ee37ac"} Jul 08 17:34:29.678874 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.678853 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lcl76" event={"ID":"c85077e5-ea69-4b35-ae77-eaca46d27586","Type":"ContainerStarted","Data":"57f40ad0dcfddb623f79836cd3879fa04132e42d0eb52a628755620e3d9dce4f"} Jul 08 17:34:29.679998 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.679978 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-r5djz" event={"ID":"84f80313-db9a-4e96-b7e0-41817cd010cd","Type":"ContainerStarted","Data":"6379f4c03c7126a62c1dd4f61f359f4a326a5b6c7bd9e5bc50375ca14ef3a565"} Jul 08 17:34:29.681048 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.681025 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jbpgz" event={"ID":"df5881fe-22be-4a83-a4b4-616788ea2372","Type":"ContainerStarted","Data":"191ffe2f12f882cd0b65f3502e3b7f9f38264959fc4836fc0db85a84ada24adb"} Jul 08 17:34:29.682120 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.682103 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xcp9j" event={"ID":"d359c83a-ba83-4914-85cc-d2b35b37759c","Type":"ContainerStarted","Data":"d9525ce28222b14c37d29adfb7a4c34f140c3cca7d94fd008710ecb48d421b29"} Jul 08 17:34:29.683176 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.683158 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vbzn4" event={"ID":"6a728e39-6156-4484-91e0-d9fdf3caf22e","Type":"ContainerStarted","Data":"80bd14bdd397a744774a1f41c1369c2fe67397528e7de3995c3c61c35866add4"} Jul 08 17:34:29.692974 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.692930 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xn2w6" podStartSLOduration=67.692916099 podStartE2EDuration="1m7.692916099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:33:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:34:29.692106966 +0000 UTC m=+67.928499218" watchObservedRunningTime="2026-07-08 17:34:29.692916099 +0000 UTC m=+67.929308451" Jul 08 17:34:29.714113 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:29.714056 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" podStartSLOduration=67.714039189 podStartE2EDuration="1m7.714039189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:33:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:34:29.713522224 +0000 UTC m=+67.949914478" watchObservedRunningTime="2026-07-08 17:34:29.714039189 +0000 UTC m=+67.950431443" Jul 08 17:34:30.303759 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:30.302552 2552 scope.go:117] "RemoveContainer" containerID="afe390545e3d119d63cd98a56be60b933343e9fa6c4f003759f438229f0056e1" Jul 08 17:34:30.313269 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:30.313211 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-cb559779c-fbv6t" Jul 08 17:34:30.316442 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:30.316150 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:34:30.316442 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:34:30.316442 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:34:30.316442 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:34:30.316442 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:30.316192 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:34:30.701338 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:30.697155 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lcl76" event={"ID":"c85077e5-ea69-4b35-ae77-eaca46d27586","Type":"ContainerStarted","Data":"687f6fbe072c69d5d6192423a016cd585a78dd73c53e0b0b7c8033b0ecbc26bc"} Jul 08 17:34:31.314347 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:31.314309 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:34:31.314347 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:34:31.314347 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:34:31.314347 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:34:31.314861 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:31.314386 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:34:32.314351 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:32.314318 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:34:32.314351 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:34:32.314351 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:34:32.314351 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:34:32.314884 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:32.314371 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:34:33.314415 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:33.314030 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:34:33.314415 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:34:33.314415 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:34:33.314415 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:34:33.314415 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:33.314103 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:34:34.314409 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:34.314379 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:34:34.314409 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:34:34.314409 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:34:34.314409 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:34:34.314865 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:34.314427 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:34:35.028780 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:35.028745 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:35.313908 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:35.313835 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:34:35.313908 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:34:35.313908 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:34:35.313908 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:34:35.313908 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:35.313898 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:34:36.313899 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:36.313865 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:34:36.313899 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:34:36.313899 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:34:36.313899 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:34:36.314385 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:36.313934 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:34:36.722341 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:36.722272 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-r5djz" event={"ID":"84f80313-db9a-4e96-b7e0-41817cd010cd","Type":"ContainerStarted","Data":"6025ba5247b8b909dacb625bb098822af432cfb78b3110a5f426fd2fd1038768"} Jul 08 17:34:36.724233 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:36.724201 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jbpgz" event={"ID":"df5881fe-22be-4a83-a4b4-616788ea2372","Type":"ContainerStarted","Data":"ffaa72f808941188afd5ee58490e0b12015b04f206213e6918cf1b6b7259fc53"} Jul 08 17:34:36.724350 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:36.724251 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jbpgz" event={"ID":"df5881fe-22be-4a83-a4b4-616788ea2372","Type":"ContainerStarted","Data":"bd4f3276f54508f34896814fe1e57f5e1e6e2022741a4483dae87c3c039c0760"} Jul 08 17:34:36.726174 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:36.726142 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xcp9j" event={"ID":"d359c83a-ba83-4914-85cc-d2b35b37759c","Type":"ContainerStarted","Data":"1e7ede2b1cb7186fddf0a7cd926367eedad078f1836f0cf69d47661aca54950e"} Jul 08 17:34:36.726280 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:36.726197 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xcp9j" event={"ID":"d359c83a-ba83-4914-85cc-d2b35b37759c","Type":"ContainerStarted","Data":"1945aa6aee15604a2dea56e7a3add17e95fcc4b98830de2f0622dab96520fbc8"} Jul 08 17:34:36.727983 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:36.727955 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vbzn4" event={"ID":"6a728e39-6156-4484-91e0-d9fdf3caf22e","Type":"ContainerStarted","Data":"98120d855aed59bffe77bbb93f66f5b40e5df664aa66ba170da34daa76e75415"} Jul 08 17:34:36.731524 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:36.731502 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-mnhqg_058a4314-4829-4b3d-a275-477b305bcf91/console-operator/1.log" Jul 08 17:34:36.731671 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:36.731599 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-mnhqg" event={"ID":"058a4314-4829-4b3d-a275-477b305bcf91","Type":"ContainerStarted","Data":"5ffb1e25df23c4eec4204d75b8fbbe6b463f9fd46201fe16f6250fae57af7a40"} Jul 08 17:34:36.732362 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:36.732276 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-mnhqg" Jul 08 17:34:36.734832 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:36.734804 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6nwml" event={"ID":"eb33c2b1-0214-4114-8873-f58efeea8193","Type":"ContainerStarted","Data":"6face78844293c9f96c8b434485d915628155bf8f58c50178d79b23e568ae7c5"} Jul 08 17:34:36.734936 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:36.734851 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6nwml" event={"ID":"eb33c2b1-0214-4114-8873-f58efeea8193","Type":"ContainerStarted","Data":"e16faaf941c062d98e95bb74ac3d70060f30d858b447fbc55a3a5dd6928cf24c"} Jul 08 17:34:36.735126 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:36.735108 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6nwml" Jul 08 17:34:36.736522 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:36.736500 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6nt78" event={"ID":"309592bc-ee3f-4203-a296-13edbb56a985","Type":"ContainerStarted","Data":"0e22dc249b1d1ad38b63ae405281e53c69bf8c3ed9f8986dce7582022184bf58"} Jul 08 17:34:36.738582 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:36.738562 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lcl76" event={"ID":"c85077e5-ea69-4b35-ae77-eaca46d27586","Type":"ContainerStarted","Data":"f46840c2acda4ca7f21b46c47c91bea8e5ceee4ae29d7f7426f6aa86228e887f"} Jul 08 17:34:36.742332 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:36.742292 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-cb559779c-fbv6t" podStartSLOduration=67.742280096 podStartE2EDuration="1m7.742280096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:33:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:34:29.735337241 +0000 UTC m=+67.971729494" watchObservedRunningTime="2026-07-08 17:34:36.742280096 +0000 UTC m=+74.978672349" Jul 08 17:34:36.742813 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:36.742773 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-r5djz" podStartSLOduration=46.235184706 podStartE2EDuration="52.742763214s" totalImagesPullingTime="6.507578508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:33:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:34:36.741566337 +0000 UTC m=+74.977958592" watchObservedRunningTime="2026-07-08 17:34:36.742763214 +0000 UTC m=+74.979155467" Jul 08 17:34:36.783113 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:36.783059 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-jbpgz" podStartSLOduration=61.25216963 podStartE2EDuration="1m7.783038811s" totalImagesPullingTime="6.530869181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:33:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:34:36.782318297 +0000 UTC m=+75.018710551" watchObservedRunningTime="2026-07-08 17:34:36.783038811 +0000 UTC m=+75.019431065" Jul 08 17:34:36.783637 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:36.783606 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xcp9j" podStartSLOduration=68.053756332 podStartE2EDuration="1m14.783595894s" totalImagesPullingTime="6.729839562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:33:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:34:36.764343368 +0000 UTC m=+75.000735621" watchObservedRunningTime="2026-07-08 17:34:36.783595894 +0000 UTC m=+75.019988142" Jul 08 17:34:36.833704 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:36.833599 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lcl76" podStartSLOduration=17.445184112 podStartE2EDuration="27.833581139s" totalImagesPullingTime="10.388397027s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:34:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:34:36.804066266 +0000 UTC m=+75.040458520" watchObservedRunningTime="2026-07-08 17:34:36.833581139 +0000 UTC m=+75.069973391" Jul 08 17:34:36.833704 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:36.833696 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6nt78" podStartSLOduration=67.781358273 podStartE2EDuration="1m14.833692236s" totalImagesPullingTime="7.052333963s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 17:33:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:34:36.832843815 +0000 UTC m=+75.069236068" watchObservedRunningTime="2026-07-08 17:34:36.833692236 +0000 UTC m=+75.070084488" Jul 08 17:34:36.855667 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:36.855619 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-vbzn4" podStartSLOduration=61.209212056 podStartE2EDuration="1m7.855602414s" totalImagesPullingTime="6.646390358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:33:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:34:36.854633669 +0000 UTC m=+75.091025923" watchObservedRunningTime="2026-07-08 17:34:36.855602414 +0000 UTC m=+75.091994671" Jul 08 17:34:36.878050 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:36.878002 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-mnhqg" podStartSLOduration=58.005316549 podStartE2EDuration="1m7.877981317s" totalImagesPullingTime="9.872664768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:33:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:34:36.877026318 +0000 UTC m=+75.113418573" watchObservedRunningTime="2026-07-08 17:34:36.877981317 +0000 UTC m=+75.114373572" Jul 08 17:34:36.878712 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:36.878687 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:36.901023 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:36.900965 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6nwml" podStartSLOduration=33.371908555 podStartE2EDuration="39.900950122s" totalImagesPullingTime="6.529041567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:33:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:34:36.900278109 +0000 UTC m=+75.136670345" watchObservedRunningTime="2026-07-08 17:34:36.900950122 +0000 UTC m=+75.137342375" Jul 08 17:34:36.944856 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:36.944827 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:37.009347 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:37.009320 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-mnhqg" Jul 08 17:34:37.218879 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:37.218850 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:37.313615 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:37.313586 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:34:37.313615 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:34:37.313615 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:34:37.313615 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:34:37.313829 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:37.313643 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:34:37.583844 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:37.583764 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:37.684486 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:37.684453 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:37.782846 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:37.782813 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:38.313855 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:38.313821 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:34:38.313855 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:34:38.313855 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:34:38.313855 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:34:38.314107 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:38.313883 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:34:38.688054 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:38.687945 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:38.892702 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:38.892657 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:39.084041 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:39.084006 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:39.313014 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:39.312976 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-cb559779c-fbv6t" Jul 08 17:34:39.314005 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:39.313978 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:34:39.314005 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:34:39.314005 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:34:39.314005 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:34:39.314197 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:39.314023 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:34:39.721565 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:39.721511 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:40.299471 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:40.299437 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:40.314008 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:40.313977 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:34:40.314008 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:34:40.314008 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:34:40.314008 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:34:40.314189 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:40.314029 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:34:40.397163 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:40.397129 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:41.314199 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:41.314167 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:34:41.314199 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:34:41.314199 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:34:41.314199 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:34:41.314729 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:41.314225 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:34:42.313752 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:42.313719 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:34:42.313752 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:34:42.313752 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:34:42.313752 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:34:42.313989 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:42.313773 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:34:43.313715 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:43.313589 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:34:43.313715 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:34:43.313715 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:34:43.313715 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:34:43.313715 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:43.313651 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:34:44.313820 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:44.313787 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:34:44.313820 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:34:44.313820 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:34:44.313820 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:34:44.314294 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:44.313845 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:34:45.314022 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:45.313980 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:34:45.314022 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:34:45.314022 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:34:45.314022 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:34:45.314575 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:45.314046 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:34:46.313777 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:46.313738 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:34:46.313777 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:34:46.313777 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:34:46.313777 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:34:46.314297 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:46.313798 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:34:47.313423 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:47.313390 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:34:47.313423 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:34:47.313423 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:34:47.313423 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:34:47.313682 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:47.313453 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:34:47.748950 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:47.748924 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6nwml" Jul 08 17:34:48.313837 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:48.313801 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:34:48.313837 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:34:48.313837 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:34:48.313837 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:34:48.314076 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:48.313849 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:34:49.291453 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:49.291420 2552 patch_prober.go:28] interesting pod/image-registry-5c988458c8-vlhfb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 08 17:34:49.291817 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:49.291476 2552 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" podUID="d93a5ee1-5553-4ad9-ade1-352ce4a76d06" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 17:34:49.313531 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:49.313504 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:34:49.313531 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:34:49.313531 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:34:49.313531 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:34:49.313748 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:49.313601 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:34:50.313599 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:50.313568 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:34:50.313599 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:34:50.313599 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:34:50.313599 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:34:50.314038 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:50.313619 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:34:50.701959 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:50.701926 2552 patch_prober.go:28] interesting pod/image-registry-5c988458c8-vlhfb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 08 17:34:50.702201 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:50.701984 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" podUID="d93a5ee1-5553-4ad9-ade1-352ce4a76d06" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 17:34:51.313847 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:51.313813 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:34:51.313847 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:34:51.313847 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:34:51.313847 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:34:51.314296 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:51.313866 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:34:52.313522 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:52.313489 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:34:52.313522 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:34:52.313522 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:34:52.313522 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:34:52.313797 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:52.313561 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:34:52.460967 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:52.460938 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:52.572775 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:52.572685 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:53.313585 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:53.313551 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:34:53.313585 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:34:53.313585 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:34:53.313585 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:34:53.313826 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:53.313609 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:34:53.729072 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:53.729033 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:54.314231 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:54.314194 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:34:54.314231 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:34:54.314231 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:34:54.314231 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:34:54.314587 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:54.314257 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:34:55.300428 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:55.300389 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:55.313918 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:55.313887 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:34:55.313918 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:34:55.313918 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:34:55.313918 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:34:55.314130 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:55.313936 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:34:55.362107 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:55.362077 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:34:56.313360 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:56.313328 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:34:56.313360 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:34:56.313360 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:34:56.313360 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:34:56.313801 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:56.313376 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:34:57.314335 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:57.314298 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:34:57.314335 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:34:57.314335 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:34:57.314335 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:34:57.314788 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:57.314367 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:34:58.313880 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:58.313844 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:34:58.313880 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:34:58.313880 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:34:58.313880 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:34:58.314128 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:58.313906 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:34:59.290838 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:59.290796 2552 patch_prober.go:28] interesting pod/image-registry-5c988458c8-vlhfb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 08 17:34:59.291190 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:59.290847 2552 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" podUID="d93a5ee1-5553-4ad9-ade1-352ce4a76d06" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 17:34:59.313806 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:59.313775 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:34:59.313806 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:34:59.313806 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:34:59.313806 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:34:59.314003 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:34:59.313818 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:00.313420 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:00.313387 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:00.313420 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:00.313420 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:00.313420 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:00.313877 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:00.313450 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:00.700042 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:00.700016 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xn2w6" Jul 08 17:35:00.702584 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:00.702528 2552 patch_prober.go:28] interesting pod/image-registry-5c988458c8-vlhfb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 08 17:35:00.702706 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:00.702617 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" podUID="d93a5ee1-5553-4ad9-ade1-352ce4a76d06" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 17:35:01.314083 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:01.314047 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:01.314083 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:01.314083 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:01.314083 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:01.314528 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:01.314104 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:02.313906 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:02.313876 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:02.313906 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:02.313906 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:02.313906 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:02.314341 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:02.313925 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:03.313603 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:03.313567 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:03.313603 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:03.313603 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:03.313603 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:03.313839 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:03.313635 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:04.313818 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:04.313783 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:04.313818 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:04.313818 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:04.313818 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:04.314264 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:04.313843 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:05.314230 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:05.314195 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:05.314230 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:05.314230 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:05.314230 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:05.314715 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:05.314252 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:06.313938 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:06.313906 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:06.313938 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:06.313938 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:06.313938 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:06.314180 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:06.313954 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:07.313961 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:07.313928 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:07.313961 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:07.313961 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:07.313961 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:07.314402 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:07.313980 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:08.314267 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:08.314229 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:08.314267 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:08.314267 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:08.314267 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:08.314811 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:08.314290 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:09.291184 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:09.291149 2552 patch_prober.go:28] interesting pod/image-registry-5c988458c8-vlhfb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 08 17:35:09.291353 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:09.291209 2552 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" podUID="d93a5ee1-5553-4ad9-ade1-352ce4a76d06" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 17:35:09.291353 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:09.291256 2552 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:35:09.291753 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:09.291709 2552 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"d1d7359a4183fa031ff3228ea7792c58d5e69c0a24a5c15832644ed88d002f6c"} pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" containerMessage="Container registry failed liveness probe, will be restarted" Jul 08 17:35:09.295077 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:09.295051 2552 patch_prober.go:28] interesting pod/image-registry-5c988458c8-vlhfb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 08 17:35:09.295171 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:09.295092 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" podUID="d93a5ee1-5553-4ad9-ade1-352ce4a76d06" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 17:35:09.314114 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:09.314090 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:09.314114 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:09.314114 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:09.314114 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:09.314300 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:09.314132 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:10.257655 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:10.257622 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-tqn2r"] Jul 08 17:35:10.314094 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:10.314058 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:10.314094 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:10.314094 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:10.314094 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:10.314572 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:10.314135 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:10.377504 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:10.377474 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:10.489484 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:10.489448 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-tqn2r"] Jul 08 17:35:10.489667 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:10.489599 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-tqn2r" Jul 08 17:35:10.492118 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:10.492091 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-7cc9w\"" Jul 08 17:35:10.492317 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:10.492298 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 08 17:35:10.492615 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:10.492596 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 08 17:35:10.509890 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:10.509828 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:10.584647 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:10.584615 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2xdt\" (UniqueName: \"kubernetes.io/projected/2c5bd086-641a-45bc-8e73-bc2c535cfcd5-kube-api-access-p2xdt\") pod \"downloads-685bfb5f64-tqn2r\" (UID: \"2c5bd086-641a-45bc-8e73-bc2c535cfcd5\") " pod="openshift-console/downloads-685bfb5f64-tqn2r" Jul 08 17:35:10.658013 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:10.657980 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:10.685759 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:10.685730 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2xdt\" (UniqueName: \"kubernetes.io/projected/2c5bd086-641a-45bc-8e73-bc2c535cfcd5-kube-api-access-p2xdt\") pod \"downloads-685bfb5f64-tqn2r\" (UID: \"2c5bd086-641a-45bc-8e73-bc2c535cfcd5\") " pod="openshift-console/downloads-685bfb5f64-tqn2r" Jul 08 17:35:10.704184 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:10.704157 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2xdt\" (UniqueName: \"kubernetes.io/projected/2c5bd086-641a-45bc-8e73-bc2c535cfcd5-kube-api-access-p2xdt\") pod \"downloads-685bfb5f64-tqn2r\" (UID: \"2c5bd086-641a-45bc-8e73-bc2c535cfcd5\") " pod="openshift-console/downloads-685bfb5f64-tqn2r" Jul 08 17:35:10.755618 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:10.755586 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:10.799925 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:10.799850 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-tqn2r" Jul 08 17:35:10.953229 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:10.953196 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-tqn2r"] Jul 08 17:35:10.956743 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:35:10.956717 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c5bd086_641a_45bc_8e73_bc2c535cfcd5.slice/crio-142869949a194acadc5ed9c13099d53d623d1a2d8c8919fc9a442290eae52244 WatchSource:0}: Error finding container 142869949a194acadc5ed9c13099d53d623d1a2d8c8919fc9a442290eae52244: Status 404 returned error can't find the container with id 142869949a194acadc5ed9c13099d53d623d1a2d8c8919fc9a442290eae52244 Jul 08 17:35:11.314099 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:11.314066 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:11.314099 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:11.314099 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:11.314099 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:11.314339 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:11.314118 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:11.867009 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:11.866968 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-tqn2r" event={"ID":"2c5bd086-641a-45bc-8e73-bc2c535cfcd5","Type":"ContainerStarted","Data":"142869949a194acadc5ed9c13099d53d623d1a2d8c8919fc9a442290eae52244"} Jul 08 17:35:12.313552 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:12.313512 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:12.313552 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:12.313552 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:12.313552 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:12.313836 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:12.313593 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:13.314077 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:13.314035 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:13.314077 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:13.314077 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:13.314077 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:13.314523 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:13.314095 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:14.314197 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:14.314158 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:14.314197 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:14.314197 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:14.314197 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:14.314699 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:14.314231 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:15.314118 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:15.314080 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:15.314118 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:15.314118 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:15.314118 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:15.314681 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:15.314157 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:15.827382 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:15.827341 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:15.897843 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:15.897809 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:16.275103 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:16.275070 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:16.313857 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:16.313829 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:16.313857 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:16.313857 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:16.313857 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:16.314099 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:16.313876 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:17.314305 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:17.314266 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:17.314305 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:17.314305 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:17.314305 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:17.314855 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:17.314331 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:18.314370 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:18.314336 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:18.314370 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:18.314370 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:18.314370 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:18.314921 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:18.314401 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:18.429070 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:18.429029 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:19.295752 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:19.295723 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:35:19.313427 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:19.313395 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:19.313427 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:19.313427 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:19.313427 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:19.313643 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:19.313444 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:19.700615 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:19.700564 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:19.761491 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:19.761458 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:19.946186 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:19.946152 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:20.048178 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.048092 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:20.187630 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.187593 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:20.215824 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.215792 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-s77mr"] Jul 08 17:35:20.218518 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.218495 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s77mr" Jul 08 17:35:20.226980 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.226450 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lq4rt"] Jul 08 17:35:20.227913 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.227427 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 08 17:35:20.227913 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.227448 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 08 17:35:20.228204 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.228182 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 08 17:35:20.228326 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.228282 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 08 17:35:20.228475 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.228453 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zcdmt\"" Jul 08 17:35:20.229656 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.229637 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lq4rt" Jul 08 17:35:20.231749 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.231712 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 08 17:35:20.232174 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.232154 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 08 17:35:20.232278 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.232160 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 08 17:35:20.232584 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.232564 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-s59xn\"" Jul 08 17:35:20.251125 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.251104 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lq4rt"] Jul 08 17:35:20.261905 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.261878 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkgss\" (UniqueName: \"kubernetes.io/projected/c98da5ae-30b2-4512-83e2-33c12ac50891-kube-api-access-gkgss\") pod \"node-exporter-s77mr\" (UID: \"c98da5ae-30b2-4512-83e2-33c12ac50891\") " pod="openshift-monitoring/node-exporter-s77mr" Jul 08 17:35:20.262017 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.261913 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17139921-5264-4d9c-85b8-f0ed12897f22-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-lq4rt\" (UID: \"17139921-5264-4d9c-85b8-f0ed12897f22\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lq4rt" Jul 08 17:35:20.262017 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.261940 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c98da5ae-30b2-4512-83e2-33c12ac50891-node-exporter-tls\") pod \"node-exporter-s77mr\" (UID: \"c98da5ae-30b2-4512-83e2-33c12ac50891\") " pod="openshift-monitoring/node-exporter-s77mr" Jul 08 17:35:20.262017 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.261996 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c98da5ae-30b2-4512-83e2-33c12ac50891-node-exporter-accelerators-collector-config\") pod \"node-exporter-s77mr\" (UID: \"c98da5ae-30b2-4512-83e2-33c12ac50891\") " pod="openshift-monitoring/node-exporter-s77mr" Jul 08 17:35:20.262159 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.262058 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/17139921-5264-4d9c-85b8-f0ed12897f22-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-lq4rt\" (UID: \"17139921-5264-4d9c-85b8-f0ed12897f22\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lq4rt" Jul 08 17:35:20.262159 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.262106 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/17139921-5264-4d9c-85b8-f0ed12897f22-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-lq4rt\" (UID: \"17139921-5264-4d9c-85b8-f0ed12897f22\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lq4rt" Jul 08 17:35:20.262266 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.262172 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c98da5ae-30b2-4512-83e2-33c12ac50891-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s77mr\" (UID: \"c98da5ae-30b2-4512-83e2-33c12ac50891\") " pod="openshift-monitoring/node-exporter-s77mr" Jul 08 17:35:20.262266 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.262221 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc7z6\" (UniqueName: \"kubernetes.io/projected/17139921-5264-4d9c-85b8-f0ed12897f22-kube-api-access-cc7z6\") pod \"kube-state-metrics-7c9dbb8b7d-lq4rt\" (UID: \"17139921-5264-4d9c-85b8-f0ed12897f22\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lq4rt" Jul 08 17:35:20.262266 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.262253 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c98da5ae-30b2-4512-83e2-33c12ac50891-node-exporter-textfile\") pod \"node-exporter-s77mr\" (UID: \"c98da5ae-30b2-4512-83e2-33c12ac50891\") " pod="openshift-monitoring/node-exporter-s77mr" Jul 08 17:35:20.262436 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.262281 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c98da5ae-30b2-4512-83e2-33c12ac50891-metrics-client-ca\") pod \"node-exporter-s77mr\" (UID: \"c98da5ae-30b2-4512-83e2-33c12ac50891\") " pod="openshift-monitoring/node-exporter-s77mr" Jul 08 17:35:20.262436 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.262324 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/17139921-5264-4d9c-85b8-f0ed12897f22-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-lq4rt\" (UID: \"17139921-5264-4d9c-85b8-f0ed12897f22\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lq4rt" Jul 08 17:35:20.262436 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.262347 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c98da5ae-30b2-4512-83e2-33c12ac50891-sys\") pod \"node-exporter-s77mr\" (UID: \"c98da5ae-30b2-4512-83e2-33c12ac50891\") " pod="openshift-monitoring/node-exporter-s77mr" Jul 08 17:35:20.262436 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.262378 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c98da5ae-30b2-4512-83e2-33c12ac50891-node-exporter-wtmp\") pod \"node-exporter-s77mr\" (UID: \"c98da5ae-30b2-4512-83e2-33c12ac50891\") " pod="openshift-monitoring/node-exporter-s77mr" Jul 08 17:35:20.262436 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.262412 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17139921-5264-4d9c-85b8-f0ed12897f22-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-lq4rt\" (UID: \"17139921-5264-4d9c-85b8-f0ed12897f22\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lq4rt" Jul 08 17:35:20.262693 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.262438 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c98da5ae-30b2-4512-83e2-33c12ac50891-root\") pod \"node-exporter-s77mr\" (UID: \"c98da5ae-30b2-4512-83e2-33c12ac50891\") " pod="openshift-monitoring/node-exporter-s77mr" Jul 08 17:35:20.296667 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.296626 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:20.313790 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.313720 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:20.313790 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:20.313790 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:20.313790 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:20.314032 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.313791 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:20.363209 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.363179 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc7z6\" (UniqueName: \"kubernetes.io/projected/17139921-5264-4d9c-85b8-f0ed12897f22-kube-api-access-cc7z6\") pod \"kube-state-metrics-7c9dbb8b7d-lq4rt\" (UID: \"17139921-5264-4d9c-85b8-f0ed12897f22\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lq4rt" Jul 08 17:35:20.363368 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.363214 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c98da5ae-30b2-4512-83e2-33c12ac50891-node-exporter-textfile\") pod \"node-exporter-s77mr\" (UID: \"c98da5ae-30b2-4512-83e2-33c12ac50891\") " pod="openshift-monitoring/node-exporter-s77mr" Jul 08 17:35:20.363368 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.363249 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c98da5ae-30b2-4512-83e2-33c12ac50891-metrics-client-ca\") pod \"node-exporter-s77mr\" (UID: \"c98da5ae-30b2-4512-83e2-33c12ac50891\") " pod="openshift-monitoring/node-exporter-s77mr" Jul 08 17:35:20.363368 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.363281 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/17139921-5264-4d9c-85b8-f0ed12897f22-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-lq4rt\" (UID: \"17139921-5264-4d9c-85b8-f0ed12897f22\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lq4rt" Jul 08 17:35:20.363368 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.363305 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c98da5ae-30b2-4512-83e2-33c12ac50891-sys\") pod \"node-exporter-s77mr\" (UID: \"c98da5ae-30b2-4512-83e2-33c12ac50891\") " pod="openshift-monitoring/node-exporter-s77mr" Jul 08 17:35:20.363368 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.363350 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c98da5ae-30b2-4512-83e2-33c12ac50891-node-exporter-wtmp\") pod \"node-exporter-s77mr\" (UID: \"c98da5ae-30b2-4512-83e2-33c12ac50891\") " pod="openshift-monitoring/node-exporter-s77mr" Jul 08 17:35:20.363683 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.363404 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17139921-5264-4d9c-85b8-f0ed12897f22-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-lq4rt\" (UID: \"17139921-5264-4d9c-85b8-f0ed12897f22\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lq4rt" Jul 08 17:35:20.363683 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.363432 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c98da5ae-30b2-4512-83e2-33c12ac50891-root\") pod \"node-exporter-s77mr\" (UID: \"c98da5ae-30b2-4512-83e2-33c12ac50891\") " pod="openshift-monitoring/node-exporter-s77mr" Jul 08 17:35:20.363683 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.363464 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkgss\" (UniqueName: \"kubernetes.io/projected/c98da5ae-30b2-4512-83e2-33c12ac50891-kube-api-access-gkgss\") pod \"node-exporter-s77mr\" (UID: \"c98da5ae-30b2-4512-83e2-33c12ac50891\") " pod="openshift-monitoring/node-exporter-s77mr" Jul 08 17:35:20.363683 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.363507 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17139921-5264-4d9c-85b8-f0ed12897f22-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-lq4rt\" (UID: \"17139921-5264-4d9c-85b8-f0ed12897f22\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lq4rt" Jul 08 17:35:20.363683 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.363564 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c98da5ae-30b2-4512-83e2-33c12ac50891-node-exporter-tls\") pod \"node-exporter-s77mr\" (UID: \"c98da5ae-30b2-4512-83e2-33c12ac50891\") " pod="openshift-monitoring/node-exporter-s77mr" Jul 08 17:35:20.363683 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.363586 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c98da5ae-30b2-4512-83e2-33c12ac50891-node-exporter-textfile\") pod \"node-exporter-s77mr\" (UID: \"c98da5ae-30b2-4512-83e2-33c12ac50891\") " pod="openshift-monitoring/node-exporter-s77mr" Jul 08 17:35:20.363683 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.363599 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c98da5ae-30b2-4512-83e2-33c12ac50891-node-exporter-accelerators-collector-config\") pod \"node-exporter-s77mr\" (UID: \"c98da5ae-30b2-4512-83e2-33c12ac50891\") " pod="openshift-monitoring/node-exporter-s77mr" Jul 08 17:35:20.363683 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.363662 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/17139921-5264-4d9c-85b8-f0ed12897f22-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-lq4rt\" (UID: \"17139921-5264-4d9c-85b8-f0ed12897f22\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lq4rt" Jul 08 17:35:20.364073 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.363722 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/17139921-5264-4d9c-85b8-f0ed12897f22-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-lq4rt\" (UID: \"17139921-5264-4d9c-85b8-f0ed12897f22\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lq4rt" Jul 08 17:35:20.364073 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.363755 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c98da5ae-30b2-4512-83e2-33c12ac50891-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s77mr\" (UID: \"c98da5ae-30b2-4512-83e2-33c12ac50891\") " pod="openshift-monitoring/node-exporter-s77mr" Jul 08 17:35:20.364073 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.364021 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c98da5ae-30b2-4512-83e2-33c12ac50891-metrics-client-ca\") pod \"node-exporter-s77mr\" (UID: \"c98da5ae-30b2-4512-83e2-33c12ac50891\") " pod="openshift-monitoring/node-exporter-s77mr" Jul 08 17:35:20.364073 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.364064 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/17139921-5264-4d9c-85b8-f0ed12897f22-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-lq4rt\" (UID: \"17139921-5264-4d9c-85b8-f0ed12897f22\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lq4rt" Jul 08 17:35:20.364259 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.364084 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c98da5ae-30b2-4512-83e2-33c12ac50891-sys\") pod \"node-exporter-s77mr\" (UID: \"c98da5ae-30b2-4512-83e2-33c12ac50891\") " pod="openshift-monitoring/node-exporter-s77mr" Jul 08 17:35:20.364259 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.364065 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c98da5ae-30b2-4512-83e2-33c12ac50891-node-exporter-accelerators-collector-config\") pod \"node-exporter-s77mr\" (UID: \"c98da5ae-30b2-4512-83e2-33c12ac50891\") " pod="openshift-monitoring/node-exporter-s77mr" Jul 08 17:35:20.364259 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.364116 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17139921-5264-4d9c-85b8-f0ed12897f22-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-lq4rt\" (UID: \"17139921-5264-4d9c-85b8-f0ed12897f22\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lq4rt" Jul 08 17:35:20.364259 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:35:20.364174 2552 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 08 17:35:20.364259 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.364200 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c98da5ae-30b2-4512-83e2-33c12ac50891-node-exporter-wtmp\") pod \"node-exporter-s77mr\" (UID: \"c98da5ae-30b2-4512-83e2-33c12ac50891\") " pod="openshift-monitoring/node-exporter-s77mr" Jul 08 17:35:20.364259 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:35:20.364228 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c98da5ae-30b2-4512-83e2-33c12ac50891-node-exporter-tls podName:c98da5ae-30b2-4512-83e2-33c12ac50891 nodeName:}" failed. No retries permitted until 2026-07-08 17:35:20.864209002 +0000 UTC m=+119.100601247 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c98da5ae-30b2-4512-83e2-33c12ac50891-node-exporter-tls") pod "node-exporter-s77mr" (UID: "c98da5ae-30b2-4512-83e2-33c12ac50891") : secret "node-exporter-tls" not found Jul 08 17:35:20.364259 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:35:20.364262 2552 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 08 17:35:20.364706 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:35:20.364310 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/17139921-5264-4d9c-85b8-f0ed12897f22-kube-state-metrics-tls podName:17139921-5264-4d9c-85b8-f0ed12897f22 nodeName:}" failed. No retries permitted until 2026-07-08 17:35:20.864295066 +0000 UTC m=+119.100687297 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/17139921-5264-4d9c-85b8-f0ed12897f22-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-lq4rt" (UID: "17139921-5264-4d9c-85b8-f0ed12897f22") : secret "kube-state-metrics-tls" not found Jul 08 17:35:20.364706 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.364360 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c98da5ae-30b2-4512-83e2-33c12ac50891-root\") pod \"node-exporter-s77mr\" (UID: \"c98da5ae-30b2-4512-83e2-33c12ac50891\") " pod="openshift-monitoring/node-exporter-s77mr" Jul 08 17:35:20.364706 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.364435 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/17139921-5264-4d9c-85b8-f0ed12897f22-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-lq4rt\" (UID: \"17139921-5264-4d9c-85b8-f0ed12897f22\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lq4rt" Jul 08 17:35:20.366568 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.366517 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c98da5ae-30b2-4512-83e2-33c12ac50891-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s77mr\" (UID: \"c98da5ae-30b2-4512-83e2-33c12ac50891\") " pod="openshift-monitoring/node-exporter-s77mr" Jul 08 17:35:20.366876 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.366847 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17139921-5264-4d9c-85b8-f0ed12897f22-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-lq4rt\" (UID: \"17139921-5264-4d9c-85b8-f0ed12897f22\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lq4rt" Jul 08 17:35:20.372672 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.372638 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc7z6\" (UniqueName: \"kubernetes.io/projected/17139921-5264-4d9c-85b8-f0ed12897f22-kube-api-access-cc7z6\") pod \"kube-state-metrics-7c9dbb8b7d-lq4rt\" (UID: \"17139921-5264-4d9c-85b8-f0ed12897f22\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lq4rt" Jul 08 17:35:20.376125 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.376103 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkgss\" (UniqueName: \"kubernetes.io/projected/c98da5ae-30b2-4512-83e2-33c12ac50891-kube-api-access-gkgss\") pod \"node-exporter-s77mr\" (UID: \"c98da5ae-30b2-4512-83e2-33c12ac50891\") " pod="openshift-monitoring/node-exporter-s77mr" Jul 08 17:35:20.393214 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.393188 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:20.561953 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.561919 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:20.666205 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.666118 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:20.762676 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.762514 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:20.863305 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.863265 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:20.867330 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.867293 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c98da5ae-30b2-4512-83e2-33c12ac50891-node-exporter-tls\") pod \"node-exporter-s77mr\" (UID: \"c98da5ae-30b2-4512-83e2-33c12ac50891\") " pod="openshift-monitoring/node-exporter-s77mr" Jul 08 17:35:20.867465 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.867374 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/17139921-5264-4d9c-85b8-f0ed12897f22-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-lq4rt\" (UID: \"17139921-5264-4d9c-85b8-f0ed12897f22\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lq4rt" Jul 08 17:35:20.870081 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.870059 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/17139921-5264-4d9c-85b8-f0ed12897f22-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-lq4rt\" (UID: \"17139921-5264-4d9c-85b8-f0ed12897f22\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lq4rt" Jul 08 17:35:20.870191 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:20.870060 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c98da5ae-30b2-4512-83e2-33c12ac50891-node-exporter-tls\") pod \"node-exporter-s77mr\" (UID: \"c98da5ae-30b2-4512-83e2-33c12ac50891\") " pod="openshift-monitoring/node-exporter-s77mr" Jul 08 17:35:21.130383 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:21.130355 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s77mr" Jul 08 17:35:21.139601 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:21.139515 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lq4rt" Jul 08 17:35:21.142021 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:35:21.141993 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc98da5ae_30b2_4512_83e2_33c12ac50891.slice/crio-b02fd7f49ee158d8e69fdc3a6e7c45930fdf4153b1eeff00fc72903117793193 WatchSource:0}: Error finding container b02fd7f49ee158d8e69fdc3a6e7c45930fdf4153b1eeff00fc72903117793193: Status 404 returned error can't find the container with id b02fd7f49ee158d8e69fdc3a6e7c45930fdf4153b1eeff00fc72903117793193 Jul 08 17:35:21.281398 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:21.281318 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lq4rt"] Jul 08 17:35:21.285289 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:35:21.285264 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17139921_5264_4d9c_85b8_f0ed12897f22.slice/crio-70e14c72c996956a3bbdad6f1ead54f546798b1e458f5a81f4037e00f4053ef7 WatchSource:0}: Error finding container 70e14c72c996956a3bbdad6f1ead54f546798b1e458f5a81f4037e00f4053ef7: Status 404 returned error can't find the container with id 70e14c72c996956a3bbdad6f1ead54f546798b1e458f5a81f4037e00f4053ef7 Jul 08 17:35:21.314489 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:21.314460 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:21.314489 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:21.314489 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:21.314489 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:21.314762 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:21.314512 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:21.915171 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:21.915123 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s77mr" event={"ID":"c98da5ae-30b2-4512-83e2-33c12ac50891","Type":"ContainerStarted","Data":"b02fd7f49ee158d8e69fdc3a6e7c45930fdf4153b1eeff00fc72903117793193"} Jul 08 17:35:21.916816 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:21.916731 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lq4rt" event={"ID":"17139921-5264-4d9c-85b8-f0ed12897f22","Type":"ContainerStarted","Data":"70e14c72c996956a3bbdad6f1ead54f546798b1e458f5a81f4037e00f4053ef7"} Jul 08 17:35:22.314354 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:22.314305 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:22.314354 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:22.314354 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:22.314354 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:22.314747 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:22.314373 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:22.923082 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:22.922994 2552 generic.go:356] "Generic (PLEG): container finished" podID="c98da5ae-30b2-4512-83e2-33c12ac50891" containerID="48123fbece5a730dcf8816f59e125b56fedff93ddd89e3e0d4f4f33428e0a406" exitCode=0 Jul 08 17:35:22.923473 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:22.923085 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s77mr" event={"ID":"c98da5ae-30b2-4512-83e2-33c12ac50891","Type":"ContainerDied","Data":"48123fbece5a730dcf8816f59e125b56fedff93ddd89e3e0d4f4f33428e0a406"} Jul 08 17:35:22.926583 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:22.925732 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lq4rt" event={"ID":"17139921-5264-4d9c-85b8-f0ed12897f22","Type":"ContainerStarted","Data":"190e65638c120e32ac7a9361217ba4d26e1d43e8249a0017deaaebff451be83b"} Jul 08 17:35:22.926583 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:22.925792 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lq4rt" event={"ID":"17139921-5264-4d9c-85b8-f0ed12897f22","Type":"ContainerStarted","Data":"791586ba3427a3391c391ae8781c2884259e7e0c3367dba92b66ecb5ae37a625"} Jul 08 17:35:22.926583 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:22.925820 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lq4rt" event={"ID":"17139921-5264-4d9c-85b8-f0ed12897f22","Type":"ContainerStarted","Data":"c4362dd954d3e5d4c07e8098560c9ae35b33c2ee807d2e80fb5a1635252b82c6"} Jul 08 17:35:22.998845 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:22.998797 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-lq4rt" podStartSLOduration=1.8172882270000001 podStartE2EDuration="2.998774649s" totalImagesPullingTime="1.181486422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:35:22.997673217 +0000 UTC m=+121.234065471" watchObservedRunningTime="2026-07-08 17:35:22.998774649 +0000 UTC m=+121.235166904" Jul 08 17:35:23.314371 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:23.314329 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:23.314371 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:23.314371 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:23.314371 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:23.314708 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:23.314403 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:23.933427 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:23.933340 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s77mr" event={"ID":"c98da5ae-30b2-4512-83e2-33c12ac50891","Type":"ContainerStarted","Data":"29344ecccd849abdab7ea9b38cdf116cd217eedda07c88956d74b3c2f0e5f40f"} Jul 08 17:35:23.933427 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:23.933409 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s77mr" event={"ID":"c98da5ae-30b2-4512-83e2-33c12ac50891","Type":"ContainerStarted","Data":"6c4b14a9bbf7deace827110f168ef410aa6f14a97c1214f5a283efa6704d1909"} Jul 08 17:35:23.960167 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:23.960113 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-s77mr" podStartSLOduration=2.533906408 podStartE2EDuration="3.960093191s" totalImagesPullingTime="1.322077568s" totalInitContainerRuntime="104.109215ms" isStatefulPod=true podCreationTimestamp="2026-07-08 17:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:35:23.95971961 +0000 UTC m=+122.196111865" watchObservedRunningTime="2026-07-08 17:35:23.960093191 +0000 UTC m=+122.196485446" Jul 08 17:35:24.314211 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.314164 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:24.314211 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:24.314211 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:24.314211 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:24.314479 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.314222 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:24.601701 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.601615 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-844cf886cf-glmng"] Jul 08 17:35:24.604176 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.604154 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-844cf886cf-glmng" Jul 08 17:35:24.607470 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.607441 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-7pv8q\"" Jul 08 17:35:24.607645 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.607492 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 08 17:35:24.607645 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.607600 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 08 17:35:24.607724 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.607499 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4cvql8j1a252o\"" Jul 08 17:35:24.607724 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.607449 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 08 17:35:24.608148 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.608123 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 08 17:35:24.618057 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.618034 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-844cf886cf-glmng"] Jul 08 17:35:24.699438 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.699397 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c4cc398e-96c5-41d4-b8ed-34f85022d530-secret-metrics-server-tls\") pod \"metrics-server-844cf886cf-glmng\" (UID: \"c4cc398e-96c5-41d4-b8ed-34f85022d530\") " pod="openshift-monitoring/metrics-server-844cf886cf-glmng" Jul 08 17:35:24.699656 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.699448 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c4cc398e-96c5-41d4-b8ed-34f85022d530-secret-metrics-server-client-certs\") pod \"metrics-server-844cf886cf-glmng\" (UID: \"c4cc398e-96c5-41d4-b8ed-34f85022d530\") " pod="openshift-monitoring/metrics-server-844cf886cf-glmng" Jul 08 17:35:24.699656 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.699474 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c4cc398e-96c5-41d4-b8ed-34f85022d530-metrics-server-audit-profiles\") pod \"metrics-server-844cf886cf-glmng\" (UID: \"c4cc398e-96c5-41d4-b8ed-34f85022d530\") " pod="openshift-monitoring/metrics-server-844cf886cf-glmng" Jul 08 17:35:24.699656 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.699553 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c4cc398e-96c5-41d4-b8ed-34f85022d530-client-ca-bundle\") pod \"metrics-server-844cf886cf-glmng\" (UID: \"c4cc398e-96c5-41d4-b8ed-34f85022d530\") " pod="openshift-monitoring/metrics-server-844cf886cf-glmng" Jul 08 17:35:24.699776 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.699663 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c4cc398e-96c5-41d4-b8ed-34f85022d530-audit-log\") pod \"metrics-server-844cf886cf-glmng\" (UID: \"c4cc398e-96c5-41d4-b8ed-34f85022d530\") " pod="openshift-monitoring/metrics-server-844cf886cf-glmng" Jul 08 17:35:24.699776 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.699704 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l2jq\" (UniqueName: \"kubernetes.io/projected/c4cc398e-96c5-41d4-b8ed-34f85022d530-kube-api-access-5l2jq\") pod \"metrics-server-844cf886cf-glmng\" (UID: \"c4cc398e-96c5-41d4-b8ed-34f85022d530\") " pod="openshift-monitoring/metrics-server-844cf886cf-glmng" Jul 08 17:35:24.699776 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.699735 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4cc398e-96c5-41d4-b8ed-34f85022d530-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-844cf886cf-glmng\" (UID: \"c4cc398e-96c5-41d4-b8ed-34f85022d530\") " pod="openshift-monitoring/metrics-server-844cf886cf-glmng" Jul 08 17:35:24.800378 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.800332 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c4cc398e-96c5-41d4-b8ed-34f85022d530-secret-metrics-server-tls\") pod \"metrics-server-844cf886cf-glmng\" (UID: \"c4cc398e-96c5-41d4-b8ed-34f85022d530\") " pod="openshift-monitoring/metrics-server-844cf886cf-glmng" Jul 08 17:35:24.800378 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.800386 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c4cc398e-96c5-41d4-b8ed-34f85022d530-secret-metrics-server-client-certs\") pod \"metrics-server-844cf886cf-glmng\" (UID: \"c4cc398e-96c5-41d4-b8ed-34f85022d530\") " pod="openshift-monitoring/metrics-server-844cf886cf-glmng" Jul 08 17:35:24.800668 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.800407 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c4cc398e-96c5-41d4-b8ed-34f85022d530-metrics-server-audit-profiles\") pod \"metrics-server-844cf886cf-glmng\" (UID: \"c4cc398e-96c5-41d4-b8ed-34f85022d530\") " pod="openshift-monitoring/metrics-server-844cf886cf-glmng" Jul 08 17:35:24.800668 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.800428 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c4cc398e-96c5-41d4-b8ed-34f85022d530-client-ca-bundle\") pod \"metrics-server-844cf886cf-glmng\" (UID: \"c4cc398e-96c5-41d4-b8ed-34f85022d530\") " pod="openshift-monitoring/metrics-server-844cf886cf-glmng" Jul 08 17:35:24.800668 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.800479 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c4cc398e-96c5-41d4-b8ed-34f85022d530-audit-log\") pod \"metrics-server-844cf886cf-glmng\" (UID: \"c4cc398e-96c5-41d4-b8ed-34f85022d530\") " pod="openshift-monitoring/metrics-server-844cf886cf-glmng" Jul 08 17:35:24.800668 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.800520 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l2jq\" (UniqueName: \"kubernetes.io/projected/c4cc398e-96c5-41d4-b8ed-34f85022d530-kube-api-access-5l2jq\") pod \"metrics-server-844cf886cf-glmng\" (UID: \"c4cc398e-96c5-41d4-b8ed-34f85022d530\") " pod="openshift-monitoring/metrics-server-844cf886cf-glmng" Jul 08 17:35:24.800668 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.800573 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4cc398e-96c5-41d4-b8ed-34f85022d530-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-844cf886cf-glmng\" (UID: \"c4cc398e-96c5-41d4-b8ed-34f85022d530\") " pod="openshift-monitoring/metrics-server-844cf886cf-glmng" Jul 08 17:35:24.801316 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.801290 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4cc398e-96c5-41d4-b8ed-34f85022d530-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-844cf886cf-glmng\" (UID: \"c4cc398e-96c5-41d4-b8ed-34f85022d530\") " pod="openshift-monitoring/metrics-server-844cf886cf-glmng" Jul 08 17:35:24.801423 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.801398 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c4cc398e-96c5-41d4-b8ed-34f85022d530-audit-log\") pod \"metrics-server-844cf886cf-glmng\" (UID: \"c4cc398e-96c5-41d4-b8ed-34f85022d530\") " pod="openshift-monitoring/metrics-server-844cf886cf-glmng" Jul 08 17:35:24.801939 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.801916 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c4cc398e-96c5-41d4-b8ed-34f85022d530-metrics-server-audit-profiles\") pod \"metrics-server-844cf886cf-glmng\" (UID: \"c4cc398e-96c5-41d4-b8ed-34f85022d530\") " pod="openshift-monitoring/metrics-server-844cf886cf-glmng" Jul 08 17:35:24.803338 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.803318 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c4cc398e-96c5-41d4-b8ed-34f85022d530-secret-metrics-server-tls\") pod \"metrics-server-844cf886cf-glmng\" (UID: \"c4cc398e-96c5-41d4-b8ed-34f85022d530\") " pod="openshift-monitoring/metrics-server-844cf886cf-glmng" Jul 08 17:35:24.803746 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.803724 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c4cc398e-96c5-41d4-b8ed-34f85022d530-client-ca-bundle\") pod \"metrics-server-844cf886cf-glmng\" (UID: \"c4cc398e-96c5-41d4-b8ed-34f85022d530\") " pod="openshift-monitoring/metrics-server-844cf886cf-glmng" Jul 08 17:35:24.803923 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.803897 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c4cc398e-96c5-41d4-b8ed-34f85022d530-secret-metrics-server-client-certs\") pod \"metrics-server-844cf886cf-glmng\" (UID: \"c4cc398e-96c5-41d4-b8ed-34f85022d530\") " pod="openshift-monitoring/metrics-server-844cf886cf-glmng" Jul 08 17:35:24.810597 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.810571 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l2jq\" (UniqueName: \"kubernetes.io/projected/c4cc398e-96c5-41d4-b8ed-34f85022d530-kube-api-access-5l2jq\") pod \"metrics-server-844cf886cf-glmng\" (UID: \"c4cc398e-96c5-41d4-b8ed-34f85022d530\") " pod="openshift-monitoring/metrics-server-844cf886cf-glmng" Jul 08 17:35:24.917841 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.917735 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-844cf886cf-glmng" Jul 08 17:35:24.971095 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.971060 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:24.975223 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.975185 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-qz2rk"] Jul 08 17:35:24.977423 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.977403 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qz2rk" Jul 08 17:35:24.979756 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.979730 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-qvnxd\"" Jul 08 17:35:24.979895 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.979733 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 08 17:35:24.986963 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:24.986944 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-qz2rk"] Jul 08 17:35:25.037489 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:25.037450 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:25.103699 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:25.103661 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3f342cb0-b56a-4b7a-a1f4-bb746a2bfc72-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-qz2rk\" (UID: \"3f342cb0-b56a-4b7a-a1f4-bb746a2bfc72\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qz2rk" Jul 08 17:35:25.103876 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:25.103745 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm776\" (UniqueName: \"kubernetes.io/projected/3f342cb0-b56a-4b7a-a1f4-bb746a2bfc72-kube-api-access-mm776\") pod \"monitoring-plugin-d5dcff7cf-qz2rk\" (UID: \"3f342cb0-b56a-4b7a-a1f4-bb746a2bfc72\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qz2rk" Jul 08 17:35:25.183692 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:25.183597 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:25.204811 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:25.204762 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3f342cb0-b56a-4b7a-a1f4-bb746a2bfc72-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-qz2rk\" (UID: \"3f342cb0-b56a-4b7a-a1f4-bb746a2bfc72\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qz2rk" Jul 08 17:35:25.204994 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:25.204832 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm776\" (UniqueName: \"kubernetes.io/projected/3f342cb0-b56a-4b7a-a1f4-bb746a2bfc72-kube-api-access-mm776\") pod \"monitoring-plugin-d5dcff7cf-qz2rk\" (UID: \"3f342cb0-b56a-4b7a-a1f4-bb746a2bfc72\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qz2rk" Jul 08 17:35:25.207909 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:25.207881 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3f342cb0-b56a-4b7a-a1f4-bb746a2bfc72-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-qz2rk\" (UID: \"3f342cb0-b56a-4b7a-a1f4-bb746a2bfc72\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qz2rk" Jul 08 17:35:25.214258 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:25.214230 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm776\" (UniqueName: \"kubernetes.io/projected/3f342cb0-b56a-4b7a-a1f4-bb746a2bfc72-kube-api-access-mm776\") pod \"monitoring-plugin-d5dcff7cf-qz2rk\" (UID: \"3f342cb0-b56a-4b7a-a1f4-bb746a2bfc72\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qz2rk" Jul 08 17:35:25.289611 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:25.289570 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qz2rk" Jul 08 17:35:25.300284 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:25.300250 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:25.314480 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:25.314456 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:25.314480 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:25.314480 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:25.314480 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:25.314727 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:25.314532 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:25.407400 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:25.407361 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:26.313676 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:26.313637 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:26.313676 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:26.313676 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:26.313676 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:26.314192 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:26.313706 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:27.314016 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:27.313977 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:27.314016 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:27.314016 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:27.314016 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:27.314458 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:27.314035 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:28.313520 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:28.313487 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:28.313520 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:28.313520 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:28.313520 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:28.313812 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:28.313572 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:29.313484 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:29.313444 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:29.313484 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:29.313484 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:29.313484 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:29.313988 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:29.313515 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:30.290757 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:30.290735 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-qz2rk"] Jul 08 17:35:30.293085 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:35:30.293059 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f342cb0_b56a_4b7a_a1f4_bb746a2bfc72.slice/crio-96d2d914000a8cda40de10e3783d1b22876d33717673bbc8aece8812b08c67f7 WatchSource:0}: Error finding container 96d2d914000a8cda40de10e3783d1b22876d33717673bbc8aece8812b08c67f7: Status 404 returned error can't find the container with id 96d2d914000a8cda40de10e3783d1b22876d33717673bbc8aece8812b08c67f7 Jul 08 17:35:30.314060 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:30.314034 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:30.314060 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:30.314060 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:30.314060 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:30.314436 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:30.314084 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:30.315655 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:30.315634 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-844cf886cf-glmng"] Jul 08 17:35:30.317312 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:35:30.317291 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4cc398e_96c5_41d4_b8ed_34f85022d530.slice/crio-9c74aefb1e162c68ee37d260185c80f759e44236151adae53071deb69c9b21f2 WatchSource:0}: Error finding container 9c74aefb1e162c68ee37d260185c80f759e44236151adae53071deb69c9b21f2: Status 404 returned error can't find the container with id 9c74aefb1e162c68ee37d260185c80f759e44236151adae53071deb69c9b21f2 Jul 08 17:35:30.969566 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:30.969359 2552 generic.go:356] "Generic (PLEG): container finished" podID="be4b19c2-731c-4888-9120-ab3330cd01e9" containerID="4527e58f761b88c4601ace5a7b03a22f778ae35649ae84dcd209dfafb411516f" exitCode=0 Jul 08 17:35:30.969566 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:30.969466 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-kkc6p" event={"ID":"be4b19c2-731c-4888-9120-ab3330cd01e9","Type":"ContainerDied","Data":"4527e58f761b88c4601ace5a7b03a22f778ae35649ae84dcd209dfafb411516f"} Jul 08 17:35:30.970190 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:30.970160 2552 scope.go:117] "RemoveContainer" containerID="4527e58f761b88c4601ace5a7b03a22f778ae35649ae84dcd209dfafb411516f" Jul 08 17:35:30.976008 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:30.975985 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-tqn2r" event={"ID":"2c5bd086-641a-45bc-8e73-bc2c535cfcd5","Type":"ContainerStarted","Data":"1996941b56c8aab830a41a27eeba6a4cbb516e49f278233389c49ad81608399e"} Jul 08 17:35:30.976705 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:30.976636 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-tqn2r" Jul 08 17:35:30.978839 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:30.978810 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-844cf886cf-glmng" event={"ID":"c4cc398e-96c5-41d4-b8ed-34f85022d530","Type":"ContainerStarted","Data":"9c74aefb1e162c68ee37d260185c80f759e44236151adae53071deb69c9b21f2"} Jul 08 17:35:30.982037 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:30.981942 2552 generic.go:356] "Generic (PLEG): container finished" podID="a9cbbc55-704c-42c5-8ef9-c1847dd931b5" containerID="ab58271e4ccc42c18b759c3589fbd0c78c31826c21d0a3da3472d6e9ee80c0ce" exitCode=0 Jul 08 17:35:30.982037 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:30.981977 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fb5wd" event={"ID":"a9cbbc55-704c-42c5-8ef9-c1847dd931b5","Type":"ContainerDied","Data":"ab58271e4ccc42c18b759c3589fbd0c78c31826c21d0a3da3472d6e9ee80c0ce"} Jul 08 17:35:30.982306 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:30.982286 2552 scope.go:117] "RemoveContainer" containerID="ab58271e4ccc42c18b759c3589fbd0c78c31826c21d0a3da3472d6e9ee80c0ce" Jul 08 17:35:30.985277 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:30.985251 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qz2rk" event={"ID":"3f342cb0-b56a-4b7a-a1f4-bb746a2bfc72","Type":"ContainerStarted","Data":"96d2d914000a8cda40de10e3783d1b22876d33717673bbc8aece8812b08c67f7"} Jul 08 17:35:30.988081 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:30.988042 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-tqn2r" Jul 08 17:35:30.989185 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:30.988841 2552 generic.go:356] "Generic (PLEG): container finished" podID="12e2c475-d57a-4902-a4ea-810948c00c4d" containerID="59d6284efa9935b352272e6ff802d9201c7098998ac30816219fab6c17a33d00" exitCode=0 Jul 08 17:35:30.989185 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:30.988902 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gnjct" event={"ID":"12e2c475-d57a-4902-a4ea-810948c00c4d","Type":"ContainerDied","Data":"59d6284efa9935b352272e6ff802d9201c7098998ac30816219fab6c17a33d00"} Jul 08 17:35:30.989185 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:30.989171 2552 scope.go:117] "RemoveContainer" containerID="59d6284efa9935b352272e6ff802d9201c7098998ac30816219fab6c17a33d00" Jul 08 17:35:31.061527 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:31.061466 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-tqn2r" podStartSLOduration=1.796141972 podStartE2EDuration="21.061444637s" totalImagesPullingTime="19.265302665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:35:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:35:31.059143352 +0000 UTC m=+129.295535606" watchObservedRunningTime="2026-07-08 17:35:31.061444637 +0000 UTC m=+129.297836891" Jul 08 17:35:31.319504 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:31.314075 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:31.319504 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:31.319504 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:31.319504 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:31.319504 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:31.314137 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:31.998943 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:31.998203 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-fb5wd" event={"ID":"a9cbbc55-704c-42c5-8ef9-c1847dd931b5","Type":"ContainerStarted","Data":"24463896b9e5d6a715e6853f692e6088ed71675626c10f6af0c744de1440e809"} Jul 08 17:35:32.001523 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:32.001280 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-gnjct" event={"ID":"12e2c475-d57a-4902-a4ea-810948c00c4d","Type":"ContainerStarted","Data":"f1cb70cce056ce2b54b08b145fbec6683e5ef02000df366101167ba1a8367f33"} Jul 08 17:35:32.005304 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:32.004932 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-kkc6p" event={"ID":"be4b19c2-731c-4888-9120-ab3330cd01e9","Type":"ContainerStarted","Data":"1697df934ed6c270c97ec689e381e809fa877a19061d9d8e1a2e96d6f33e594c"} Jul 08 17:35:32.151682 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:32.151606 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c988458c8-vlhfb"] Jul 08 17:35:32.235307 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:32.235198 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:32.313991 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:32.313760 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:32.313991 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:32.313991 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:32.313991 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:32.313991 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:32.313812 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:32.358165 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:32.357979 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:32.457836 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:32.457766 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:33.314221 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:33.314194 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:33.314221 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:33.314221 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:33.314221 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:33.314438 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:33.314255 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:34.015930 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:34.015894 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-844cf886cf-glmng" event={"ID":"c4cc398e-96c5-41d4-b8ed-34f85022d530","Type":"ContainerStarted","Data":"151a527b7f6b1ac22bdb708cbc99b90eee2fd214a92326c81a7b826f68b8642a"} Jul 08 17:35:34.017844 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:34.017812 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qz2rk" event={"ID":"3f342cb0-b56a-4b7a-a1f4-bb746a2bfc72","Type":"ContainerStarted","Data":"23bcb969942d0436eaac9e3d801fe980342dce778aa0a61f8ad636ae69973df1"} Jul 08 17:35:34.017989 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:34.017950 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qz2rk" Jul 08 17:35:34.023695 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:34.023666 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qz2rk" Jul 08 17:35:34.036937 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:34.036878 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-844cf886cf-glmng" podStartSLOduration=7.051284739 podStartE2EDuration="10.036859205s" totalImagesPullingTime="2.985574466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:35:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:35:34.034454449 +0000 UTC m=+132.270846702" watchObservedRunningTime="2026-07-08 17:35:34.036859205 +0000 UTC m=+132.273251459" Jul 08 17:35:34.049353 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:34.049302 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-qz2rk" podStartSLOduration=7.042566758 podStartE2EDuration="10.049286631s" totalImagesPullingTime="3.006719873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:35:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:35:34.048660247 +0000 UTC m=+132.285052501" watchObservedRunningTime="2026-07-08 17:35:34.049286631 +0000 UTC m=+132.285678884" Jul 08 17:35:34.311689 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:34.311600 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" podUID="d93a5ee1-5553-4ad9-ade1-352ce4a76d06" containerName="registry" containerID="cri-o://d1d7359a4183fa031ff3228ea7792c58d5e69c0a24a5c15832644ed88d002f6c" gracePeriod=30 Jul 08 17:35:34.314332 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:34.314299 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:34.314332 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:34.314332 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:34.314332 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:34.314580 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:34.314377 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:35.025117 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:35.025085 2552 generic.go:356] "Generic (PLEG): container finished" podID="d93a5ee1-5553-4ad9-ade1-352ce4a76d06" containerID="d1d7359a4183fa031ff3228ea7792c58d5e69c0a24a5c15832644ed88d002f6c" exitCode=0 Jul 08 17:35:35.025721 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:35.025178 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" event={"ID":"d93a5ee1-5553-4ad9-ade1-352ce4a76d06","Type":"ContainerDied","Data":"d1d7359a4183fa031ff3228ea7792c58d5e69c0a24a5c15832644ed88d002f6c"} Jul 08 17:35:35.025721 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:35.025290 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" event={"ID":"d93a5ee1-5553-4ad9-ade1-352ce4a76d06","Type":"ContainerStarted","Data":"c250651dc14800655b2ad6daf18f0b8d8a95b84a27aedaccc62ef56020df43ec"} Jul 08 17:35:35.025721 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:35.025697 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:35:35.314593 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:35.314488 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:35.314593 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:35.314593 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:35.314593 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:35.314593 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:35.314577 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:35.467985 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:35.467947 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:36.313758 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:36.313721 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:36.313758 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:36.313758 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:36.313758 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:36.314286 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:36.313783 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:37.313635 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:37.313593 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:37.313635 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:37.313635 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:37.313635 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:37.314162 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:37.313660 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:38.313866 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:38.313830 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:38.313866 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:38.313866 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:38.313866 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:38.314372 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:38.313893 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:39.314308 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:39.314271 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:39.314308 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:39.314308 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:39.314308 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:39.314755 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:39.314328 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:40.314242 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:40.314210 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:40.314242 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:40.314242 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:40.314242 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:40.314779 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:40.314263 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:41.313935 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:41.313899 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:41.313935 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:41.313935 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:41.313935 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:41.314179 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:41.313987 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:42.313882 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:42.313844 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:42.313882 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:42.313882 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:42.313882 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:42.314357 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:42.313910 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:43.314198 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:43.314164 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:43.314198 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:43.314198 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:43.314198 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:43.314648 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:43.314219 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:44.313558 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:44.313511 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:44.313558 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:44.313558 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:44.313558 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:44.313870 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:44.313594 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:44.918199 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:44.918156 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-844cf886cf-glmng" Jul 08 17:35:44.918588 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:44.918222 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-844cf886cf-glmng" Jul 08 17:35:45.313257 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:45.313224 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:45.313257 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:45.313257 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:45.313257 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:45.313485 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:45.313272 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:46.314160 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:46.314120 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:46.314160 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:46.314160 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:46.314160 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:46.314734 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:46.314169 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:47.313885 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:47.313852 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:47.313885 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:47.313885 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:47.313885 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:47.314199 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:47.313908 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:48.314017 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:48.313976 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:48.314017 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:48.314017 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:48.314017 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:48.314475 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:48.314046 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:49.313886 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:49.313849 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:49.313886 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:49.313886 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:49.313886 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:49.314131 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:49.313904 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:50.314014 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:50.313980 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:50.314014 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:50.314014 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:50.314014 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:50.314523 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:50.314040 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:51.314044 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:51.314007 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:51.314044 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:51.314044 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:51.314044 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:51.314468 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:51.314062 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:52.314194 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:52.314162 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:52.314194 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:52.314194 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:52.314194 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:52.314715 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:52.314218 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:52.447801 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:52.447768 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:52.505224 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:52.505192 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:53.313427 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:53.313398 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:53.313427 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:53.313427 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:53.313427 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:53.313684 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:53.313449 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:53.776067 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:53.776038 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:53.829410 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:53.829377 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:35:54.313588 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:54.313531 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:54.313588 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:54.313588 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:54.313588 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:54.313830 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:54.313607 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:55.030776 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:55.030748 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:35:55.314147 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:55.314060 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:55.314147 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:55.314147 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:55.314147 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:55.314147 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:55.314121 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:56.313694 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:56.313662 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:56.313694 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:56.313694 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:56.313694 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:56.314116 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:56.313714 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:57.313930 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:57.313900 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:57.313930 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:57.313930 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:57.313930 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:57.314358 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:57.313951 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:58.313469 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:58.313437 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:58.313469 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:58.313469 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:58.313469 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:58.313803 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:58.313487 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:35:59.314351 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:59.314312 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:35:59.314351 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:35:59.314351 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:35:59.314351 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:35:59.314806 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:35:59.314368 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:36:00.048498 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:00.048458 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" podUID="d93a5ee1-5553-4ad9-ade1-352ce4a76d06" containerName="registry" containerID="cri-o://c250651dc14800655b2ad6daf18f0b8d8a95b84a27aedaccc62ef56020df43ec" gracePeriod=30 Jul 08 17:36:00.314108 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:00.314077 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:36:00.314108 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:36:00.314108 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:36:00.314108 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:36:00.314306 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:00.314132 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:36:00.347289 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:00.347265 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:36:00.521250 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:00.521220 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-installation-pull-secrets\") pod \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " Jul 08 17:36:00.521436 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:00.521257 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-registry-certificates\") pod \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " Jul 08 17:36:00.521436 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:00.521302 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-image-registry-private-configuration\") pod \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " Jul 08 17:36:00.521436 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:00.521334 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-ca-trust-extracted\") pod \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " Jul 08 17:36:00.521436 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:00.521354 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-registry-tls\") pod \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " Jul 08 17:36:00.521436 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:00.521369 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-bound-sa-token\") pod \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " Jul 08 17:36:00.521436 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:00.521410 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htpnc\" (UniqueName: \"kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-kube-api-access-htpnc\") pod \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " Jul 08 17:36:00.521770 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:00.521605 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-trusted-ca\") pod \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\" (UID: \"d93a5ee1-5553-4ad9-ade1-352ce4a76d06\") " Jul 08 17:36:00.522408 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:00.522233 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d93a5ee1-5553-4ad9-ade1-352ce4a76d06" (UID: "d93a5ee1-5553-4ad9-ade1-352ce4a76d06"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:36:00.522780 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:00.522738 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d93a5ee1-5553-4ad9-ade1-352ce4a76d06" (UID: "d93a5ee1-5553-4ad9-ade1-352ce4a76d06"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 17:36:00.524306 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:00.524268 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d93a5ee1-5553-4ad9-ade1-352ce4a76d06" (UID: "d93a5ee1-5553-4ad9-ade1-352ce4a76d06"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 17:36:00.524520 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:00.524494 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-kube-api-access-htpnc" (OuterVolumeSpecName: "kube-api-access-htpnc") pod "d93a5ee1-5553-4ad9-ade1-352ce4a76d06" (UID: "d93a5ee1-5553-4ad9-ade1-352ce4a76d06"). InnerVolumeSpecName "kube-api-access-htpnc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:36:00.524603 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:00.524564 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d93a5ee1-5553-4ad9-ade1-352ce4a76d06" (UID: "d93a5ee1-5553-4ad9-ade1-352ce4a76d06"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:36:00.524603 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:00.524575 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d93a5ee1-5553-4ad9-ade1-352ce4a76d06" (UID: "d93a5ee1-5553-4ad9-ade1-352ce4a76d06"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 17:36:00.524771 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:00.524753 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d93a5ee1-5553-4ad9-ade1-352ce4a76d06" (UID: "d93a5ee1-5553-4ad9-ade1-352ce4a76d06"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:36:00.530052 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:00.530027 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d93a5ee1-5553-4ad9-ade1-352ce4a76d06" (UID: "d93a5ee1-5553-4ad9-ade1-352ce4a76d06"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:36:00.623102 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:00.623015 2552 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-ca-trust-extracted\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 17:36:00.623102 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:00.623047 2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-registry-tls\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 17:36:00.623102 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:00.623057 2552 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-bound-sa-token\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 17:36:00.623102 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:00.623064 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htpnc\" (UniqueName: \"kubernetes.io/projected/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-kube-api-access-htpnc\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 17:36:00.623102 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:00.623074 2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-trusted-ca\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 17:36:00.623102 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:00.623083 2552 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-installation-pull-secrets\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 17:36:00.623102 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:00.623091 2552 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-registry-certificates\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 17:36:00.623102 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:00.623100 2552 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d93a5ee1-5553-4ad9-ade1-352ce4a76d06-image-registry-private-configuration\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 17:36:01.127139 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:01.127102 2552 generic.go:356] "Generic (PLEG): container finished" podID="d93a5ee1-5553-4ad9-ade1-352ce4a76d06" containerID="c250651dc14800655b2ad6daf18f0b8d8a95b84a27aedaccc62ef56020df43ec" exitCode=0 Jul 08 17:36:01.127324 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:01.127151 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" Jul 08 17:36:01.127324 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:01.127185 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" event={"ID":"d93a5ee1-5553-4ad9-ade1-352ce4a76d06","Type":"ContainerDied","Data":"c250651dc14800655b2ad6daf18f0b8d8a95b84a27aedaccc62ef56020df43ec"} Jul 08 17:36:01.127324 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:01.127241 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c988458c8-vlhfb" event={"ID":"d93a5ee1-5553-4ad9-ade1-352ce4a76d06","Type":"ContainerDied","Data":"ffb8fc7362ba01a27d966a2f7c1b1857481a4e456f1abe6faac3ef87382e2ca1"} Jul 08 17:36:01.127324 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:01.127262 2552 scope.go:117] "RemoveContainer" containerID="c250651dc14800655b2ad6daf18f0b8d8a95b84a27aedaccc62ef56020df43ec" Jul 08 17:36:01.135960 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:01.135944 2552 scope.go:117] "RemoveContainer" containerID="d1d7359a4183fa031ff3228ea7792c58d5e69c0a24a5c15832644ed88d002f6c" Jul 08 17:36:01.143361 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:01.143346 2552 scope.go:117] "RemoveContainer" containerID="c250651dc14800655b2ad6daf18f0b8d8a95b84a27aedaccc62ef56020df43ec" Jul 08 17:36:01.143679 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:36:01.143653 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c250651dc14800655b2ad6daf18f0b8d8a95b84a27aedaccc62ef56020df43ec\": container with ID starting with c250651dc14800655b2ad6daf18f0b8d8a95b84a27aedaccc62ef56020df43ec not found: ID does not exist" containerID="c250651dc14800655b2ad6daf18f0b8d8a95b84a27aedaccc62ef56020df43ec" Jul 08 17:36:01.143735 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:01.143693 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c250651dc14800655b2ad6daf18f0b8d8a95b84a27aedaccc62ef56020df43ec"} err="failed to get container status \"c250651dc14800655b2ad6daf18f0b8d8a95b84a27aedaccc62ef56020df43ec\": rpc error: code = NotFound desc = could not find container \"c250651dc14800655b2ad6daf18f0b8d8a95b84a27aedaccc62ef56020df43ec\": container with ID starting with c250651dc14800655b2ad6daf18f0b8d8a95b84a27aedaccc62ef56020df43ec not found: ID does not exist" Jul 08 17:36:01.143735 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:01.143718 2552 scope.go:117] "RemoveContainer" containerID="d1d7359a4183fa031ff3228ea7792c58d5e69c0a24a5c15832644ed88d002f6c" Jul 08 17:36:01.143970 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:36:01.143953 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1d7359a4183fa031ff3228ea7792c58d5e69c0a24a5c15832644ed88d002f6c\": container with ID starting with d1d7359a4183fa031ff3228ea7792c58d5e69c0a24a5c15832644ed88d002f6c not found: ID does not exist" containerID="d1d7359a4183fa031ff3228ea7792c58d5e69c0a24a5c15832644ed88d002f6c" Jul 08 17:36:01.144010 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:01.143977 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1d7359a4183fa031ff3228ea7792c58d5e69c0a24a5c15832644ed88d002f6c"} err="failed to get container status \"d1d7359a4183fa031ff3228ea7792c58d5e69c0a24a5c15832644ed88d002f6c\": rpc error: code = NotFound desc = could not find container \"d1d7359a4183fa031ff3228ea7792c58d5e69c0a24a5c15832644ed88d002f6c\": container with ID starting with d1d7359a4183fa031ff3228ea7792c58d5e69c0a24a5c15832644ed88d002f6c not found: ID does not exist" Jul 08 17:36:01.154424 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:01.154398 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c988458c8-vlhfb"] Jul 08 17:36:01.158340 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:01.158320 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5c988458c8-vlhfb"] Jul 08 17:36:01.314086 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:01.314016 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:36:01.314086 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:36:01.314086 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:36:01.314086 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:36:01.314086 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:01.314069 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:36:02.305836 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:02.305804 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d93a5ee1-5553-4ad9-ade1-352ce4a76d06" path="/var/lib/kubelet/pods/d93a5ee1-5553-4ad9-ade1-352ce4a76d06/volumes" Jul 08 17:36:02.314004 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:02.313976 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:36:02.314004 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:36:02.314004 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:36:02.314004 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:36:02.314285 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:02.314032 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:36:03.314052 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:03.314018 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:36:03.314052 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:36:03.314052 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:36:03.314052 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:36:03.314485 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:03.314076 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:36:04.314110 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:04.314078 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:36:04.314110 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:36:04.314110 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:36:04.314110 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:36:04.314650 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:04.314129 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:36:04.923836 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:04.923805 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-844cf886cf-glmng" Jul 08 17:36:04.927460 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:04.927438 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-844cf886cf-glmng" Jul 08 17:36:05.313716 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:05.313680 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:36:05.313716 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:36:05.313716 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:36:05.313716 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:36:05.313953 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:05.313741 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:36:06.313865 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:06.313830 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:36:06.313865 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:36:06.313865 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:36:06.313865 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:36:06.314416 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:06.313884 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:36:07.314081 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:07.314044 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:36:07.314081 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:36:07.314081 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:36:07.314081 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:36:07.314507 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:07.314110 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:36:08.314159 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:08.314122 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:36:08.314159 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:36:08.314159 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:36:08.314159 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:36:08.314604 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:08.314185 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:36:09.313741 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:09.313704 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:36:09.313741 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:36:09.313741 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:36:09.313741 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:36:09.313979 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:09.313759 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:36:10.314003 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:10.313972 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:36:10.314003 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:36:10.314003 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:36:10.314003 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:36:10.314438 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:10.314029 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:36:11.314311 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:11.314277 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:36:11.314311 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:36:11.314311 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:36:11.314311 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:36:11.314762 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:11.314343 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:36:12.313835 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:12.313802 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:36:12.313835 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:36:12.313835 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:36:12.313835 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:36:12.314063 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:12.313852 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:36:13.313778 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:13.313689 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:36:13.313778 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:36:13.313778 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:36:13.313778 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:36:13.313778 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:13.313765 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:36:14.313672 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:14.313641 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:36:14.313672 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:36:14.313672 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:36:14.313672 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:36:14.314171 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:14.313695 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:36:15.313558 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:15.313507 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:36:15.313558 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:36:15.313558 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:36:15.313558 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:36:15.314168 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:15.313598 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:36:16.313471 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:16.313433 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:36:16.313471 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:36:16.313471 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:36:16.313471 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:36:16.313714 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:16.313498 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:36:17.313909 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:17.313873 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:36:17.313909 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:36:17.313909 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:36:17.313909 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:36:17.314371 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:17.313928 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:36:17.317409 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:17.317379 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:17.374448 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:17.374417 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:17.435675 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:17.435644 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:17.536151 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:17.536116 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:17.599114 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:17.599038 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:18.308424 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:18.308390 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:18.313374 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:18.313347 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:36:18.313374 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:36:18.313374 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:36:18.313374 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:36:18.313593 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:18.313408 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:36:18.374679 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:18.374646 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:18.744164 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:18.744131 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:19.297580 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:19.297551 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:19.313658 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:19.313628 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:36:19.313658 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:36:19.313658 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:36:19.313658 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:36:19.313871 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:19.313676 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:36:19.355192 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:19.355168 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:20.313907 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:20.313874 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:36:20.313907 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:36:20.313907 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:36:20.313907 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:36:20.314346 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:20.313924 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:36:21.314136 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:21.314094 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:36:21.314136 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:36:21.314136 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:36:21.314136 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:36:21.314682 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:21.314165 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:36:22.314091 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:22.314058 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:36:22.314091 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:36:22.314091 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:36:22.314091 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:36:22.314629 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:22.314126 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:36:23.314237 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:23.314202 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:36:23.314237 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:36:23.314237 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:36:23.314237 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:36:23.314707 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:23.314257 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:36:24.313604 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:24.313569 2552 patch_prober.go:28] interesting pod/router-default-cb559779c-fbv6t container/router namespace/openshift-ingress: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[-]backend-proxy-http failed: reason withheld Jul 08 17:36:24.313604 ip-10-0-130-38 kubenswrapper[2552]: [-]has-synced failed: reason withheld Jul 08 17:36:24.313604 ip-10-0-130-38 kubenswrapper[2552]: [+]process-running ok Jul 08 17:36:24.313604 ip-10-0-130-38 kubenswrapper[2552]: healthz check failed Jul 08 17:36:24.313870 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:24.313630 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/router-default-cb559779c-fbv6t" podUID="eba717c9-222d-4dcf-a495-4e79977b5a93" containerName="router" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 08 17:36:24.786279 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:24.786249 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:24.890840 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:24.890808 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:24.949729 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:24.949700 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:25.314388 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:25.314362 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-cb559779c-fbv6t" Jul 08 17:36:25.315649 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:25.315627 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-cb559779c-fbv6t" Jul 08 17:36:25.684277 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:25.684197 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:25.963798 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:25.963769 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:26.024045 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:26.023994 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:28.099970 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:28.099939 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:28.163342 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:28.163307 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:28.685146 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:28.685112 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:28.786006 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:28.785973 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:29.661916 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:29.661885 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:29.735765 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:29.735732 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:36.842732 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:36.842693 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:37.757208 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:37.757178 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:37.854413 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:37.854387 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:37.954666 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:37.954638 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:38.055384 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:38.055308 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:38.723753 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:38.723699 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:38.795139 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:38.795112 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:39.537234 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:39.537205 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:39.644754 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:39.644716 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:39.745195 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:39.745161 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:49.551368 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:49.551333 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:49.651736 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:49.651710 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:49.715122 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:49.715093 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:55.134282 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:55.134242 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:55.193519 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:55.193484 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:55.295741 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:55.295712 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:36:55.349730 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:36:55.349702 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:37:10.294496 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:37:10.294462 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:37:10.556214 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:37:10.556125 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:38:12.738592 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:38:12.738555 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:38:22.186343 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:38:22.186314 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-mnhqg_058a4314-4829-4b3d-a275-477b305bcf91/console-operator/1.log" Jul 08 17:38:22.194473 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:38:22.194445 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-mnhqg_058a4314-4829-4b3d-a275-477b305bcf91/console-operator/1.log" Jul 08 17:38:22.196651 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:38:22.196632 2552 kubelet.go:1648] "Image garbage collection succeeded" Jul 08 17:40:24.336951 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:40:24.336916 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:40:26.522276 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:40:26.522246 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:40:26.624489 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:40:26.624450 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:40:26.723551 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:40:26.723511 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:40:29.574908 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:40:29.574867 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:41:02.824420 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:41:02.824381 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:41:39.475095 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:41:39.475056 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:41:39.576928 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:41:39.576890 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:41:51.395176 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:41:51.395132 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:41:51.452769 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:41:51.452729 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:41:53.146271 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:41:53.146238 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:41:53.288467 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:41:53.288416 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:41:53.343781 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:41:53.343747 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:41:53.889325 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:41:53.889277 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:41:53.990830 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:41:53.990795 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:41:55.297598 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:41:55.297556 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:41:55.398793 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:41:55.398763 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:41:55.673569 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:41:55.673463 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:41:55.892597 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:41:55.892562 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:41:55.948094 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:41:55.948065 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:42:04.599168 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:42:04.599133 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:42:05.031326 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:42:05.031286 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:42:05.137969 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:42:05.137939 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:42:08.437133 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:42:08.437098 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:42:53.174938 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:42:53.174841 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:42:53.245831 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:42:53.245800 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:22.216492 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:22.216460 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-mnhqg_058a4314-4829-4b3d-a275-477b305bcf91/console-operator/1.log" Jul 08 17:43:22.219054 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:22.219031 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-mnhqg_058a4314-4829-4b3d-a275-477b305bcf91/console-operator/1.log" Jul 08 17:43:26.801907 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:26.801869 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:28.051999 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:28.051962 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:28.955206 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:28.955173 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hgzcv"] Jul 08 17:43:28.955457 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:28.955445 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d93a5ee1-5553-4ad9-ade1-352ce4a76d06" containerName="registry" Jul 08 17:43:28.955499 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:28.955459 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="d93a5ee1-5553-4ad9-ade1-352ce4a76d06" containerName="registry" Jul 08 17:43:28.955533 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:28.955523 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="d93a5ee1-5553-4ad9-ade1-352ce4a76d06" containerName="registry" Jul 08 17:43:28.957225 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:28.957210 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hgzcv" Jul 08 17:43:28.959629 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:28.959608 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:43:28.959745 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:28.959656 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-kxxtl\"" Jul 08 17:43:28.959745 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:28.959668 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 08 17:43:28.970517 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:28.970493 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hgzcv"] Jul 08 17:43:29.132752 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:29.132705 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkvkk\" (UniqueName: \"kubernetes.io/projected/4111cada-28e3-4f1e-8b0c-93825b418328-kube-api-access-fkvkk\") pod \"cert-manager-operator-controller-manager-55c444bf86-hgzcv\" (UID: \"4111cada-28e3-4f1e-8b0c-93825b418328\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hgzcv" Jul 08 17:43:29.133133 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:29.132789 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4111cada-28e3-4f1e-8b0c-93825b418328-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-hgzcv\" (UID: \"4111cada-28e3-4f1e-8b0c-93825b418328\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hgzcv" Jul 08 17:43:29.233638 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:29.233532 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkvkk\" (UniqueName: \"kubernetes.io/projected/4111cada-28e3-4f1e-8b0c-93825b418328-kube-api-access-fkvkk\") pod \"cert-manager-operator-controller-manager-55c444bf86-hgzcv\" (UID: \"4111cada-28e3-4f1e-8b0c-93825b418328\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hgzcv" Jul 08 17:43:29.233638 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:29.233633 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4111cada-28e3-4f1e-8b0c-93825b418328-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-hgzcv\" (UID: \"4111cada-28e3-4f1e-8b0c-93825b418328\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hgzcv" Jul 08 17:43:29.233969 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:29.233954 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4111cada-28e3-4f1e-8b0c-93825b418328-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-hgzcv\" (UID: \"4111cada-28e3-4f1e-8b0c-93825b418328\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hgzcv" Jul 08 17:43:29.249213 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:29.249182 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkvkk\" (UniqueName: \"kubernetes.io/projected/4111cada-28e3-4f1e-8b0c-93825b418328-kube-api-access-fkvkk\") pod \"cert-manager-operator-controller-manager-55c444bf86-hgzcv\" (UID: \"4111cada-28e3-4f1e-8b0c-93825b418328\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hgzcv" Jul 08 17:43:29.266123 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:29.266102 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hgzcv" Jul 08 17:43:29.420085 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:29.420060 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hgzcv"] Jul 08 17:43:29.423171 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:43:29.423144 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4111cada_28e3_4f1e_8b0c_93825b418328.slice/crio-213a978b8a42b3987f70fb2489ac411aea5b1e26c95f4d16782fd49859eb6a38 WatchSource:0}: Error finding container 213a978b8a42b3987f70fb2489ac411aea5b1e26c95f4d16782fd49859eb6a38: Status 404 returned error can't find the container with id 213a978b8a42b3987f70fb2489ac411aea5b1e26c95f4d16782fd49859eb6a38 Jul 08 17:43:29.425840 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:29.425822 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 17:43:29.790435 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:29.790390 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hgzcv" event={"ID":"4111cada-28e3-4f1e-8b0c-93825b418328","Type":"ContainerStarted","Data":"213a978b8a42b3987f70fb2489ac411aea5b1e26c95f4d16782fd49859eb6a38"} Jul 08 17:43:31.762766 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:31.762738 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:31.801795 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:31.801763 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hgzcv" event={"ID":"4111cada-28e3-4f1e-8b0c-93825b418328","Type":"ContainerStarted","Data":"725142b3d47ddc0a66c543acb2fbc52257cf9ebb6ceae2a2ca486e1b0735e4a8"} Jul 08 17:43:31.966365 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:31.966262 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:32.342949 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:32.342851 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:32.589841 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:32.589806 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:32.826778 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:32.826743 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:33.286489 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.286436 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-hgzcv" podStartSLOduration=3.007114847 podStartE2EDuration="5.286418401s" totalImagesPullingTime="2.279303554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:43:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:43:31.841877479 +0000 UTC m=+610.078269735" watchObservedRunningTime="2026-07-08 17:43:33.286418401 +0000 UTC m=+611.522810653" Jul 08 17:43:33.287448 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.287427 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7zdck"] Jul 08 17:43:33.287742 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.287730 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d93a5ee1-5553-4ad9-ade1-352ce4a76d06" containerName="registry" Jul 08 17:43:33.287781 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.287745 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="d93a5ee1-5553-4ad9-ade1-352ce4a76d06" containerName="registry" Jul 08 17:43:33.287820 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.287804 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="d93a5ee1-5553-4ad9-ade1-352ce4a76d06" containerName="registry" Jul 08 17:43:33.289737 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.289723 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7zdck" Jul 08 17:43:33.293226 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.293205 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 17:43:33.293438 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.293421 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-4hh8m\"" Jul 08 17:43:33.294066 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.294050 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 17:43:33.313968 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.313939 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7zdck"] Jul 08 17:43:33.400624 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.400592 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-72g5d"] Jul 08 17:43:33.402693 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.402677 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-72g5d" Jul 08 17:43:33.405089 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.405058 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 08 17:43:33.405182 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.405143 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-cg6g6\"" Jul 08 17:43:33.405508 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.405492 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 08 17:43:33.438236 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.438200 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-72g5d"] Jul 08 17:43:33.469903 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.469865 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef1001be-68ea-428e-a505-3239adf0aad7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7zdck\" (UID: \"ef1001be-68ea-428e-a505-3239adf0aad7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7zdck" Jul 08 17:43:33.470074 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.469924 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef1001be-68ea-428e-a505-3239adf0aad7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7zdck\" (UID: \"ef1001be-68ea-428e-a505-3239adf0aad7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7zdck" Jul 08 17:43:33.470074 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.469998 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf84x\" (UniqueName: \"kubernetes.io/projected/ef1001be-68ea-428e-a505-3239adf0aad7-kube-api-access-lf84x\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7zdck\" (UID: \"ef1001be-68ea-428e-a505-3239adf0aad7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7zdck" Jul 08 17:43:33.571364 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.571275 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0fab4a5-56bc-4f85-b647-78a988d55581-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-72g5d\" (UID: \"b0fab4a5-56bc-4f85-b647-78a988d55581\") " pod="cert-manager/cert-manager-webhook-6486ffd997-72g5d" Jul 08 17:43:33.571364 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.571318 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef1001be-68ea-428e-a505-3239adf0aad7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7zdck\" (UID: \"ef1001be-68ea-428e-a505-3239adf0aad7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7zdck" Jul 08 17:43:33.571597 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.571369 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpv8z\" (UniqueName: \"kubernetes.io/projected/b0fab4a5-56bc-4f85-b647-78a988d55581-kube-api-access-hpv8z\") pod \"cert-manager-webhook-6486ffd997-72g5d\" (UID: \"b0fab4a5-56bc-4f85-b647-78a988d55581\") " pod="cert-manager/cert-manager-webhook-6486ffd997-72g5d" Jul 08 17:43:33.571597 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.571432 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf84x\" (UniqueName: \"kubernetes.io/projected/ef1001be-68ea-428e-a505-3239adf0aad7-kube-api-access-lf84x\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7zdck\" (UID: \"ef1001be-68ea-428e-a505-3239adf0aad7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7zdck" Jul 08 17:43:33.571597 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.571465 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef1001be-68ea-428e-a505-3239adf0aad7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7zdck\" (UID: \"ef1001be-68ea-428e-a505-3239adf0aad7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7zdck" Jul 08 17:43:33.571819 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.571686 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef1001be-68ea-428e-a505-3239adf0aad7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7zdck\" (UID: \"ef1001be-68ea-428e-a505-3239adf0aad7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7zdck" Jul 08 17:43:33.571819 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.571750 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef1001be-68ea-428e-a505-3239adf0aad7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7zdck\" (UID: \"ef1001be-68ea-428e-a505-3239adf0aad7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7zdck" Jul 08 17:43:33.587122 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.587087 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf84x\" (UniqueName: \"kubernetes.io/projected/ef1001be-68ea-428e-a505-3239adf0aad7-kube-api-access-lf84x\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7zdck\" (UID: \"ef1001be-68ea-428e-a505-3239adf0aad7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7zdck" Jul 08 17:43:33.598738 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.598715 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7zdck" Jul 08 17:43:33.672339 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.671931 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0fab4a5-56bc-4f85-b647-78a988d55581-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-72g5d\" (UID: \"b0fab4a5-56bc-4f85-b647-78a988d55581\") " pod="cert-manager/cert-manager-webhook-6486ffd997-72g5d" Jul 08 17:43:33.672339 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.671972 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpv8z\" (UniqueName: \"kubernetes.io/projected/b0fab4a5-56bc-4f85-b647-78a988d55581-kube-api-access-hpv8z\") pod \"cert-manager-webhook-6486ffd997-72g5d\" (UID: \"b0fab4a5-56bc-4f85-b647-78a988d55581\") " pod="cert-manager/cert-manager-webhook-6486ffd997-72g5d" Jul 08 17:43:33.685087 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.684692 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpv8z\" (UniqueName: \"kubernetes.io/projected/b0fab4a5-56bc-4f85-b647-78a988d55581-kube-api-access-hpv8z\") pod \"cert-manager-webhook-6486ffd997-72g5d\" (UID: \"b0fab4a5-56bc-4f85-b647-78a988d55581\") " pod="cert-manager/cert-manager-webhook-6486ffd997-72g5d" Jul 08 17:43:33.685087 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.684750 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b0fab4a5-56bc-4f85-b647-78a988d55581-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-72g5d\" (UID: \"b0fab4a5-56bc-4f85-b647-78a988d55581\") " pod="cert-manager/cert-manager-webhook-6486ffd997-72g5d" Jul 08 17:43:33.718625 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.718593 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-72g5d" Jul 08 17:43:33.741039 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.740953 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7zdck"] Jul 08 17:43:33.744118 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:43:33.744093 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef1001be_68ea_428e_a505_3239adf0aad7.slice/crio-72264d79bf7e78a50799d4339714a722b34b462d431145a36b54cbc0e2aa04a9 WatchSource:0}: Error finding container 72264d79bf7e78a50799d4339714a722b34b462d431145a36b54cbc0e2aa04a9: Status 404 returned error can't find the container with id 72264d79bf7e78a50799d4339714a722b34b462d431145a36b54cbc0e2aa04a9 Jul 08 17:43:33.812091 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.812053 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7zdck" event={"ID":"ef1001be-68ea-428e-a505-3239adf0aad7","Type":"ContainerStarted","Data":"72264d79bf7e78a50799d4339714a722b34b462d431145a36b54cbc0e2aa04a9"} Jul 08 17:43:33.858469 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:33.858385 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-72g5d"] Jul 08 17:43:33.861170 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:43:33.861143 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0fab4a5_56bc_4f85_b647_78a988d55581.slice/crio-b06b13fe9c20b301a22c925a39ffef0176880871b4ee343a483f08d3d160a144 WatchSource:0}: Error finding container b06b13fe9c20b301a22c925a39ffef0176880871b4ee343a483f08d3d160a144: Status 404 returned error can't find the container with id b06b13fe9c20b301a22c925a39ffef0176880871b4ee343a483f08d3d160a144 Jul 08 17:43:34.758928 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:34.758862 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:34.821191 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:34.821153 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-72g5d" event={"ID":"b0fab4a5-56bc-4f85-b647-78a988d55581","Type":"ContainerStarted","Data":"b06b13fe9c20b301a22c925a39ffef0176880871b4ee343a483f08d3d160a144"} Jul 08 17:43:35.190748 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:35.190712 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:35.251668 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:35.251634 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qt54b"] Jul 08 17:43:35.254281 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:35.254256 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qt54b" Jul 08 17:43:35.264252 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:35.264230 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-wgj7w\"" Jul 08 17:43:35.283711 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:35.283629 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qt54b"] Jul 08 17:43:35.386527 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:35.386479 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9029243-9285-4448-918c-f388e29b80e4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qt54b\" (UID: \"c9029243-9285-4448-918c-f388e29b80e4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qt54b" Jul 08 17:43:35.386713 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:35.386678 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcc5j\" (UniqueName: \"kubernetes.io/projected/c9029243-9285-4448-918c-f388e29b80e4-kube-api-access-pcc5j\") pod \"cert-manager-cainjector-559cdd8c87-qt54b\" (UID: \"c9029243-9285-4448-918c-f388e29b80e4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qt54b" Jul 08 17:43:35.487418 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:35.487337 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcc5j\" (UniqueName: \"kubernetes.io/projected/c9029243-9285-4448-918c-f388e29b80e4-kube-api-access-pcc5j\") pod \"cert-manager-cainjector-559cdd8c87-qt54b\" (UID: \"c9029243-9285-4448-918c-f388e29b80e4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qt54b" Jul 08 17:43:35.487418 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:35.487392 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9029243-9285-4448-918c-f388e29b80e4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qt54b\" (UID: \"c9029243-9285-4448-918c-f388e29b80e4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qt54b" Jul 08 17:43:35.499958 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:35.499926 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9029243-9285-4448-918c-f388e29b80e4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qt54b\" (UID: \"c9029243-9285-4448-918c-f388e29b80e4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qt54b" Jul 08 17:43:35.500478 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:35.500447 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcc5j\" (UniqueName: \"kubernetes.io/projected/c9029243-9285-4448-918c-f388e29b80e4-kube-api-access-pcc5j\") pod \"cert-manager-cainjector-559cdd8c87-qt54b\" (UID: \"c9029243-9285-4448-918c-f388e29b80e4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qt54b" Jul 08 17:43:35.567458 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:35.567420 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qt54b" Jul 08 17:43:36.519110 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:36.519035 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qt54b"] Jul 08 17:43:36.524417 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:43:36.524368 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9029243_9285_4448_918c_f388e29b80e4.slice/crio-71736f1b0134571dcc1918f2a9b7b5930ea649065c8140922ae35dd83d1ca4d1 WatchSource:0}: Error finding container 71736f1b0134571dcc1918f2a9b7b5930ea649065c8140922ae35dd83d1ca4d1: Status 404 returned error can't find the container with id 71736f1b0134571dcc1918f2a9b7b5930ea649065c8140922ae35dd83d1ca4d1 Jul 08 17:43:36.831651 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:36.831610 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qt54b" event={"ID":"c9029243-9285-4448-918c-f388e29b80e4","Type":"ContainerStarted","Data":"7552b7d2b3e204566f35a8f130d3673217805ef228bd1d5f9714341a7e67c7de"} Jul 08 17:43:36.831885 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:36.831665 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qt54b" event={"ID":"c9029243-9285-4448-918c-f388e29b80e4","Type":"ContainerStarted","Data":"71736f1b0134571dcc1918f2a9b7b5930ea649065c8140922ae35dd83d1ca4d1"} Jul 08 17:43:36.833410 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:36.833381 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-72g5d" event={"ID":"b0fab4a5-56bc-4f85-b647-78a988d55581","Type":"ContainerStarted","Data":"01f8e9b2d77522bff66ba54d7038adec97afc481921cdfe2136722a4e555c639"} Jul 08 17:43:36.833551 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:36.833459 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-72g5d" Jul 08 17:43:36.850236 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:36.850186 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qt54b" podStartSLOduration=1.850167489 podStartE2EDuration="1.850167489s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:43:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:43:36.848927309 +0000 UTC m=+615.085319563" watchObservedRunningTime="2026-07-08 17:43:36.850167489 +0000 UTC m=+615.086559730" Jul 08 17:43:36.875838 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:36.872831 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-72g5d" podStartSLOduration=1.331139975 podStartE2EDuration="3.872813308s" totalImagesPullingTime="2.541673333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:43:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:43:36.870777549 +0000 UTC m=+615.107169803" watchObservedRunningTime="2026-07-08 17:43:36.872813308 +0000 UTC m=+615.109205561" Jul 08 17:43:37.407632 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:37.407595 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:37.516864 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:37.516822 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:41.863192 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:41.863153 2552 generic.go:356] "Generic (PLEG): container finished" podID="ef1001be-68ea-428e-a505-3239adf0aad7" containerID="8b394cdb70e041eeaaea1cc12b5e9c699b6e03dad1ccf8a64e90608648b10f89" exitCode=0 Jul 08 17:43:41.863656 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:41.863228 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7zdck" event={"ID":"ef1001be-68ea-428e-a505-3239adf0aad7","Type":"ContainerDied","Data":"8b394cdb70e041eeaaea1cc12b5e9c699b6e03dad1ccf8a64e90608648b10f89"} Jul 08 17:43:42.839952 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:42.839919 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-72g5d" Jul 08 17:43:43.184092 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:43.183992 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:44.877510 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:44.877482 2552 generic.go:356] "Generic (PLEG): container finished" podID="ef1001be-68ea-428e-a505-3239adf0aad7" containerID="5e41565e7fbdb628db4b90bfebb99d9b017b7b7568be2e0425613345eb2e98bb" exitCode=0 Jul 08 17:43:44.877830 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:44.877529 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7zdck" event={"ID":"ef1001be-68ea-428e-a505-3239adf0aad7","Type":"ContainerDied","Data":"5e41565e7fbdb628db4b90bfebb99d9b017b7b7568be2e0425613345eb2e98bb"} Jul 08 17:43:53.922987 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:53.922948 2552 generic.go:356] "Generic (PLEG): container finished" podID="ef1001be-68ea-428e-a505-3239adf0aad7" containerID="a1e4b6b0665b388cd5a8bb4a7c4195e87a33c11727639daae7a7d727e33bfb2a" exitCode=0 Jul 08 17:43:53.923368 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:53.923029 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7zdck" event={"ID":"ef1001be-68ea-428e-a505-3239adf0aad7","Type":"ContainerDied","Data":"a1e4b6b0665b388cd5a8bb4a7c4195e87a33c11727639daae7a7d727e33bfb2a"} Jul 08 17:43:54.476751 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:54.476720 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:55.057572 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:55.057549 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7zdck" Jul 08 17:43:55.147909 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:55.147872 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef1001be-68ea-428e-a505-3239adf0aad7-util\") pod \"ef1001be-68ea-428e-a505-3239adf0aad7\" (UID: \"ef1001be-68ea-428e-a505-3239adf0aad7\") " Jul 08 17:43:55.148080 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:55.147955 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lf84x\" (UniqueName: \"kubernetes.io/projected/ef1001be-68ea-428e-a505-3239adf0aad7-kube-api-access-lf84x\") pod \"ef1001be-68ea-428e-a505-3239adf0aad7\" (UID: \"ef1001be-68ea-428e-a505-3239adf0aad7\") " Jul 08 17:43:55.148080 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:55.147973 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef1001be-68ea-428e-a505-3239adf0aad7-bundle\") pod \"ef1001be-68ea-428e-a505-3239adf0aad7\" (UID: \"ef1001be-68ea-428e-a505-3239adf0aad7\") " Jul 08 17:43:55.148393 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:55.148369 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef1001be-68ea-428e-a505-3239adf0aad7-bundle" (OuterVolumeSpecName: "bundle") pod "ef1001be-68ea-428e-a505-3239adf0aad7" (UID: "ef1001be-68ea-428e-a505-3239adf0aad7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:43:55.150284 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:55.150259 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef1001be-68ea-428e-a505-3239adf0aad7-kube-api-access-lf84x" (OuterVolumeSpecName: "kube-api-access-lf84x") pod "ef1001be-68ea-428e-a505-3239adf0aad7" (UID: "ef1001be-68ea-428e-a505-3239adf0aad7"). InnerVolumeSpecName "kube-api-access-lf84x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:43:55.152426 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:55.152406 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef1001be-68ea-428e-a505-3239adf0aad7-util" (OuterVolumeSpecName: "util") pod "ef1001be-68ea-428e-a505-3239adf0aad7" (UID: "ef1001be-68ea-428e-a505-3239adf0aad7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:43:55.248777 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:55.248740 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lf84x\" (UniqueName: \"kubernetes.io/projected/ef1001be-68ea-428e-a505-3239adf0aad7-kube-api-access-lf84x\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 17:43:55.248777 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:55.248771 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef1001be-68ea-428e-a505-3239adf0aad7-bundle\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 17:43:55.248962 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:55.248788 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef1001be-68ea-428e-a505-3239adf0aad7-util\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 17:43:55.934618 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:55.934593 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7zdck" Jul 08 17:43:55.934906 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:55.934588 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f7zdck" event={"ID":"ef1001be-68ea-428e-a505-3239adf0aad7","Type":"ContainerDied","Data":"72264d79bf7e78a50799d4339714a722b34b462d431145a36b54cbc0e2aa04a9"} Jul 08 17:43:55.934906 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:55.934709 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="72264d79bf7e78a50799d4339714a722b34b462d431145a36b54cbc0e2aa04a9" Jul 08 17:43:58.056940 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:58.056885 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:59.612008 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:59.611974 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:43:59.712884 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:43:59.712839 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:01.904085 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:01.904045 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:02.003944 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:02.003901 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:06.030038 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:06.029979 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:06.132518 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:06.132478 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:07.753511 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:07.753473 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:12.063067 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:12.063032 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:12.153666 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:12.153634 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-69b898c76d-scgsp"] Jul 08 17:44:12.153935 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:12.153923 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef1001be-68ea-428e-a505-3239adf0aad7" containerName="extract" Jul 08 17:44:12.153977 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:12.153937 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef1001be-68ea-428e-a505-3239adf0aad7" containerName="extract" Jul 08 17:44:12.153977 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:12.153952 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef1001be-68ea-428e-a505-3239adf0aad7" containerName="pull" Jul 08 17:44:12.153977 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:12.153959 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef1001be-68ea-428e-a505-3239adf0aad7" containerName="pull" Jul 08 17:44:12.153977 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:12.153968 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef1001be-68ea-428e-a505-3239adf0aad7" containerName="util" Jul 08 17:44:12.153977 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:12.153973 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef1001be-68ea-428e-a505-3239adf0aad7" containerName="util" Jul 08 17:44:12.154125 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:12.154023 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef1001be-68ea-428e-a505-3239adf0aad7" containerName="extract" Jul 08 17:44:12.155732 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:12.155716 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-69b898c76d-scgsp" Jul 08 17:44:12.159288 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:12.159247 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 08 17:44:12.159403 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:12.159307 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 08 17:44:12.160397 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:12.160382 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 08 17:44:12.160465 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:12.160427 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 08 17:44:12.160512 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:12.160485 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 08 17:44:12.160512 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:12.160493 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-vxsh2\"" Jul 08 17:44:12.180202 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:12.180180 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-69b898c76d-scgsp"] Jul 08 17:44:12.209948 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:12.209917 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:12.299791 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:12.299759 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd153588-605b-4f45-8253-7ec024dec50b-cert\") pod \"lws-controller-manager-69b898c76d-scgsp\" (UID: \"fd153588-605b-4f45-8253-7ec024dec50b\") " pod="openshift-lws-operator/lws-controller-manager-69b898c76d-scgsp" Jul 08 17:44:12.299945 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:12.299817 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fd153588-605b-4f45-8253-7ec024dec50b-metrics-cert\") pod \"lws-controller-manager-69b898c76d-scgsp\" (UID: \"fd153588-605b-4f45-8253-7ec024dec50b\") " pod="openshift-lws-operator/lws-controller-manager-69b898c76d-scgsp" Jul 08 17:44:12.299945 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:12.299872 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fd153588-605b-4f45-8253-7ec024dec50b-manager-config\") pod \"lws-controller-manager-69b898c76d-scgsp\" (UID: \"fd153588-605b-4f45-8253-7ec024dec50b\") " pod="openshift-lws-operator/lws-controller-manager-69b898c76d-scgsp" Jul 08 17:44:12.299945 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:12.299903 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58km6\" (UniqueName: \"kubernetes.io/projected/fd153588-605b-4f45-8253-7ec024dec50b-kube-api-access-58km6\") pod \"lws-controller-manager-69b898c76d-scgsp\" (UID: \"fd153588-605b-4f45-8253-7ec024dec50b\") " pod="openshift-lws-operator/lws-controller-manager-69b898c76d-scgsp" Jul 08 17:44:12.400314 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:12.400223 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58km6\" (UniqueName: \"kubernetes.io/projected/fd153588-605b-4f45-8253-7ec024dec50b-kube-api-access-58km6\") pod \"lws-controller-manager-69b898c76d-scgsp\" (UID: \"fd153588-605b-4f45-8253-7ec024dec50b\") " pod="openshift-lws-operator/lws-controller-manager-69b898c76d-scgsp" Jul 08 17:44:12.400314 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:12.400269 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd153588-605b-4f45-8253-7ec024dec50b-cert\") pod \"lws-controller-manager-69b898c76d-scgsp\" (UID: \"fd153588-605b-4f45-8253-7ec024dec50b\") " pod="openshift-lws-operator/lws-controller-manager-69b898c76d-scgsp" Jul 08 17:44:12.400314 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:12.400308 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fd153588-605b-4f45-8253-7ec024dec50b-metrics-cert\") pod \"lws-controller-manager-69b898c76d-scgsp\" (UID: \"fd153588-605b-4f45-8253-7ec024dec50b\") " pod="openshift-lws-operator/lws-controller-manager-69b898c76d-scgsp" Jul 08 17:44:12.400620 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:12.400399 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fd153588-605b-4f45-8253-7ec024dec50b-manager-config\") pod \"lws-controller-manager-69b898c76d-scgsp\" (UID: \"fd153588-605b-4f45-8253-7ec024dec50b\") " pod="openshift-lws-operator/lws-controller-manager-69b898c76d-scgsp" Jul 08 17:44:12.401244 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:12.401204 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fd153588-605b-4f45-8253-7ec024dec50b-manager-config\") pod \"lws-controller-manager-69b898c76d-scgsp\" (UID: \"fd153588-605b-4f45-8253-7ec024dec50b\") " pod="openshift-lws-operator/lws-controller-manager-69b898c76d-scgsp" Jul 08 17:44:12.403241 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:12.403217 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fd153588-605b-4f45-8253-7ec024dec50b-metrics-cert\") pod \"lws-controller-manager-69b898c76d-scgsp\" (UID: \"fd153588-605b-4f45-8253-7ec024dec50b\") " pod="openshift-lws-operator/lws-controller-manager-69b898c76d-scgsp" Jul 08 17:44:12.403339 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:12.403275 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd153588-605b-4f45-8253-7ec024dec50b-cert\") pod \"lws-controller-manager-69b898c76d-scgsp\" (UID: \"fd153588-605b-4f45-8253-7ec024dec50b\") " pod="openshift-lws-operator/lws-controller-manager-69b898c76d-scgsp" Jul 08 17:44:12.410502 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:12.410473 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58km6\" (UniqueName: \"kubernetes.io/projected/fd153588-605b-4f45-8253-7ec024dec50b-kube-api-access-58km6\") pod \"lws-controller-manager-69b898c76d-scgsp\" (UID: \"fd153588-605b-4f45-8253-7ec024dec50b\") " pod="openshift-lws-operator/lws-controller-manager-69b898c76d-scgsp" Jul 08 17:44:12.465024 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:12.465000 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-69b898c76d-scgsp" Jul 08 17:44:12.608126 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:12.608091 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-69b898c76d-scgsp"] Jul 08 17:44:12.610377 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:44:12.610351 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd153588_605b_4f45_8253_7ec024dec50b.slice/crio-4b60104246e7a189489f5ebab7f416f399bbd484b3ac975eecd8b1bd45755c78 WatchSource:0}: Error finding container 4b60104246e7a189489f5ebab7f416f399bbd484b3ac975eecd8b1bd45755c78: Status 404 returned error can't find the container with id 4b60104246e7a189489f5ebab7f416f399bbd484b3ac975eecd8b1bd45755c78 Jul 08 17:44:13.008501 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:13.008469 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-69b898c76d-scgsp" event={"ID":"fd153588-605b-4f45-8253-7ec024dec50b","Type":"ContainerStarted","Data":"4b60104246e7a189489f5ebab7f416f399bbd484b3ac975eecd8b1bd45755c78"} Jul 08 17:44:14.014059 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:14.014025 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-69b898c76d-scgsp" event={"ID":"fd153588-605b-4f45-8253-7ec024dec50b","Type":"ContainerStarted","Data":"56c919ef75ef9b3a6eaf2b8dcf32af659b740032067dc59b069d71236a345c61"} Jul 08 17:44:14.014430 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:14.014094 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-69b898c76d-scgsp" Jul 08 17:44:14.032947 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:14.032901 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-69b898c76d-scgsp" podStartSLOduration=0.813358304 podStartE2EDuration="2.032885942s" totalImagesPullingTime="1.219527638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:44:14.031577595 +0000 UTC m=+652.267969847" watchObservedRunningTime="2026-07-08 17:44:14.032885942 +0000 UTC m=+652.269278195" Jul 08 17:44:15.564700 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:15.564665 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:22.944507 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:22.944472 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:23.042693 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:23.042659 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:23.599342 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:23.599301 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:24.009484 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:24.009452 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-j64gq"] Jul 08 17:44:24.030194 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:24.030165 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-j64gq"] Jul 08 17:44:24.030348 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:24.030282 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-j64gq" Jul 08 17:44:24.032733 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:24.032708 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 08 17:44:24.032878 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:24.032708 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 08 17:44:24.032878 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:24.032827 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 08 17:44:24.033293 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:24.033268 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 08 17:44:24.033658 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:24.033634 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-98zkq\"" Jul 08 17:44:24.201968 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:24.201929 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7dcd03aa-f58a-4c4e-bad6-186f0f72e41b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b7dd476c8-j64gq\" (UID: \"7dcd03aa-f58a-4c4e-bad6-186f0f72e41b\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-j64gq" Jul 08 17:44:24.202162 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:24.201981 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7dcd03aa-f58a-4c4e-bad6-186f0f72e41b-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b7dd476c8-j64gq\" (UID: \"7dcd03aa-f58a-4c4e-bad6-186f0f72e41b\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-j64gq" Jul 08 17:44:24.202162 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:24.202035 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7dcd03aa-f58a-4c4e-bad6-186f0f72e41b-tmp\") pod \"opendatahub-operator-controller-manager-6b7dd476c8-j64gq\" (UID: \"7dcd03aa-f58a-4c4e-bad6-186f0f72e41b\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-j64gq" Jul 08 17:44:24.202162 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:24.202056 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7dcd03aa-f58a-4c4e-bad6-186f0f72e41b-manifests\") pod \"opendatahub-operator-controller-manager-6b7dd476c8-j64gq\" (UID: \"7dcd03aa-f58a-4c4e-bad6-186f0f72e41b\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-j64gq" Jul 08 17:44:24.202162 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:24.202124 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrvgn\" (UniqueName: \"kubernetes.io/projected/7dcd03aa-f58a-4c4e-bad6-186f0f72e41b-kube-api-access-hrvgn\") pod \"opendatahub-operator-controller-manager-6b7dd476c8-j64gq\" (UID: \"7dcd03aa-f58a-4c4e-bad6-186f0f72e41b\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-j64gq" Jul 08 17:44:24.269307 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:24.269231 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:24.302919 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:24.302892 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrvgn\" (UniqueName: \"kubernetes.io/projected/7dcd03aa-f58a-4c4e-bad6-186f0f72e41b-kube-api-access-hrvgn\") pod \"opendatahub-operator-controller-manager-6b7dd476c8-j64gq\" (UID: \"7dcd03aa-f58a-4c4e-bad6-186f0f72e41b\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-j64gq" Jul 08 17:44:24.303046 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:24.302966 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7dcd03aa-f58a-4c4e-bad6-186f0f72e41b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b7dd476c8-j64gq\" (UID: \"7dcd03aa-f58a-4c4e-bad6-186f0f72e41b\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-j64gq" Jul 08 17:44:24.303046 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:24.303013 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7dcd03aa-f58a-4c4e-bad6-186f0f72e41b-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b7dd476c8-j64gq\" (UID: \"7dcd03aa-f58a-4c4e-bad6-186f0f72e41b\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-j64gq" Jul 08 17:44:24.303157 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:24.303061 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7dcd03aa-f58a-4c4e-bad6-186f0f72e41b-tmp\") pod \"opendatahub-operator-controller-manager-6b7dd476c8-j64gq\" (UID: \"7dcd03aa-f58a-4c4e-bad6-186f0f72e41b\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-j64gq" Jul 08 17:44:24.303157 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:24.303104 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7dcd03aa-f58a-4c4e-bad6-186f0f72e41b-manifests\") pod \"opendatahub-operator-controller-manager-6b7dd476c8-j64gq\" (UID: \"7dcd03aa-f58a-4c4e-bad6-186f0f72e41b\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-j64gq" Jul 08 17:44:24.303557 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:24.303507 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7dcd03aa-f58a-4c4e-bad6-186f0f72e41b-manifests\") pod \"opendatahub-operator-controller-manager-6b7dd476c8-j64gq\" (UID: \"7dcd03aa-f58a-4c4e-bad6-186f0f72e41b\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-j64gq" Jul 08 17:44:24.305781 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:24.305761 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7dcd03aa-f58a-4c4e-bad6-186f0f72e41b-tmp\") pod \"opendatahub-operator-controller-manager-6b7dd476c8-j64gq\" (UID: \"7dcd03aa-f58a-4c4e-bad6-186f0f72e41b\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-j64gq" Jul 08 17:44:24.305929 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:24.305908 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7dcd03aa-f58a-4c4e-bad6-186f0f72e41b-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b7dd476c8-j64gq\" (UID: \"7dcd03aa-f58a-4c4e-bad6-186f0f72e41b\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-j64gq" Jul 08 17:44:24.305990 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:24.305912 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7dcd03aa-f58a-4c4e-bad6-186f0f72e41b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b7dd476c8-j64gq\" (UID: \"7dcd03aa-f58a-4c4e-bad6-186f0f72e41b\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-j64gq" Jul 08 17:44:24.311394 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:24.311369 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrvgn\" (UniqueName: \"kubernetes.io/projected/7dcd03aa-f58a-4c4e-bad6-186f0f72e41b-kube-api-access-hrvgn\") pod \"opendatahub-operator-controller-manager-6b7dd476c8-j64gq\" (UID: \"7dcd03aa-f58a-4c4e-bad6-186f0f72e41b\") " pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-j64gq" Jul 08 17:44:24.344897 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:24.344875 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-j64gq" Jul 08 17:44:24.370811 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:24.370783 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:24.446141 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:24.446104 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:24.498687 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:24.498531 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-j64gq"] Jul 08 17:44:24.501034 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:44:24.501008 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dcd03aa_f58a_4c4e_bad6_186f0f72e41b.slice/crio-23e60e9443ff2e545aac2c980335303a28a7a0f27f32e987d3bc6e9c4c6f030c WatchSource:0}: Error finding container 23e60e9443ff2e545aac2c980335303a28a7a0f27f32e987d3bc6e9c4c6f030c: Status 404 returned error can't find the container with id 23e60e9443ff2e545aac2c980335303a28a7a0f27f32e987d3bc6e9c4c6f030c Jul 08 17:44:24.531728 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:24.531674 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:24.634984 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:24.634931 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:24.735618 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:24.735589 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:25.020918 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:25.020887 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-69b898c76d-scgsp" Jul 08 17:44:25.065074 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:25.065035 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-j64gq" event={"ID":"7dcd03aa-f58a-4c4e-bad6-186f0f72e41b","Type":"ContainerStarted","Data":"23e60e9443ff2e545aac2c980335303a28a7a0f27f32e987d3bc6e9c4c6f030c"} Jul 08 17:44:28.087888 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:28.087851 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-j64gq" event={"ID":"7dcd03aa-f58a-4c4e-bad6-186f0f72e41b","Type":"ContainerStarted","Data":"bc1201e551970fd7864e773ce94e787be84067f9a73b48e922150f692dca91ca"} Jul 08 17:44:29.093479 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:29.093435 2552 generic.go:356] "Generic (PLEG): container finished" podID="7dcd03aa-f58a-4c4e-bad6-186f0f72e41b" containerID="bc1201e551970fd7864e773ce94e787be84067f9a73b48e922150f692dca91ca" exitCode=0 Jul 08 17:44:29.093885 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:29.093494 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-j64gq" event={"ID":"7dcd03aa-f58a-4c4e-bad6-186f0f72e41b","Type":"ContainerDied","Data":"bc1201e551970fd7864e773ce94e787be84067f9a73b48e922150f692dca91ca"} Jul 08 17:44:30.101941 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:30.101902 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-j64gq" event={"ID":"7dcd03aa-f58a-4c4e-bad6-186f0f72e41b","Type":"ContainerStarted","Data":"6b583e1ddd51dabf3aeb9bde87c30e662fc9cfa6f438cbe5f2f2bb3e687eef0a"} Jul 08 17:44:30.102342 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:30.102017 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-j64gq" Jul 08 17:44:30.128641 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:30.128586 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-j64gq" podStartSLOduration=2.462179458 podStartE2EDuration="7.128568351s" totalImagesPullingTime="3.617634246s" totalInitContainerRuntime="1.048754647s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:44:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:44:30.126611016 +0000 UTC m=+668.363003269" watchObservedRunningTime="2026-07-08 17:44:30.128568351 +0000 UTC m=+668.364960661" Jul 08 17:44:30.520145 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:30.520112 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:30.583757 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:30.583726 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:32.272433 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:32.272404 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:32.373880 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:32.373850 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:39.614095 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:39.614059 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:39.697005 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:39.696969 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:41.109527 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:41.109494 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6b7dd476c8-j64gq" Jul 08 17:44:43.342244 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:43.342206 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:43.439462 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:43.439437 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:44.048349 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:44.048320 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:44.153115 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:44.153081 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:44.304213 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:44.304118 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:44.604289 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:44.604202 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:44.701140 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:44.701104 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:53.851144 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:53.851097 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:53.964055 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:53.964011 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:54.060521 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:54.060483 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:54.240699 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:54.240666 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:54.425931 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:54.425896 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:55.164171 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:55.164140 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:55.297840 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:55.297795 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:55.768195 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:55.768160 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:56.251183 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:56.251147 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:56.457270 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:56.457241 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:44:57.518349 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:44:57.518312 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:45:01.571053 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:01.571018 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:45:01.671468 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:01.671441 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:45:01.900822 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:01.900742 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k"] Jul 08 17:45:01.907903 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:01.907879 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" Jul 08 17:45:01.911760 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:01.911741 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-nw685\"" Jul 08 17:45:01.911916 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:01.911896 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 08 17:45:01.926185 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:01.926155 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k"] Jul 08 17:45:01.950400 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:01.950365 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:45:02.008739 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:02.008706 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf457j8k\" (UID: \"6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" Jul 08 17:45:02.008940 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:02.008762 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf457j8k\" (UID: \"6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" Jul 08 17:45:02.008940 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:02.008833 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t9rt\" (UniqueName: \"kubernetes.io/projected/6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a-kube-api-access-9t9rt\") pod \"data-science-gateway-data-science-gateway-class-6576859cf457j8k\" (UID: \"6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" Jul 08 17:45:02.008940 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:02.008900 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf457j8k\" (UID: \"6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" Jul 08 17:45:02.009086 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:02.008941 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf457j8k\" (UID: \"6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" Jul 08 17:45:02.009086 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:02.008981 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf457j8k\" (UID: \"6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" Jul 08 17:45:02.009086 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:02.009004 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf457j8k\" (UID: \"6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" Jul 08 17:45:02.009086 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:02.009024 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf457j8k\" (UID: \"6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" Jul 08 17:45:02.009086 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:02.009052 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf457j8k\" (UID: \"6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" Jul 08 17:45:02.110357 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:02.110323 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf457j8k\" (UID: \"6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" Jul 08 17:45:02.110566 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:02.110369 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t9rt\" (UniqueName: \"kubernetes.io/projected/6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a-kube-api-access-9t9rt\") pod \"data-science-gateway-data-science-gateway-class-6576859cf457j8k\" (UID: \"6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" Jul 08 17:45:02.110566 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:02.110392 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf457j8k\" (UID: \"6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" Jul 08 17:45:02.110566 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:02.110423 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf457j8k\" (UID: \"6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" Jul 08 17:45:02.110566 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:02.110465 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf457j8k\" (UID: \"6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" Jul 08 17:45:02.110566 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:02.110496 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf457j8k\" (UID: \"6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" Jul 08 17:45:02.110566 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:02.110523 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf457j8k\" (UID: \"6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" Jul 08 17:45:02.110945 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:02.110570 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf457j8k\" (UID: \"6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" Jul 08 17:45:02.110945 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:02.110606 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf457j8k\" (UID: \"6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" Jul 08 17:45:02.111056 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:02.110963 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf457j8k\" (UID: \"6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" Jul 08 17:45:02.111056 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:02.110966 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf457j8k\" (UID: \"6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" Jul 08 17:45:02.111056 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:02.111002 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf457j8k\" (UID: \"6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" Jul 08 17:45:02.111213 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:02.111129 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf457j8k\" (UID: \"6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" Jul 08 17:45:02.111213 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:02.111183 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf457j8k\" (UID: \"6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" Jul 08 17:45:02.113127 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:02.113107 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf457j8k\" (UID: \"6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" Jul 08 17:45:02.113258 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:02.113234 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf457j8k\" (UID: \"6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" Jul 08 17:45:02.122869 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:02.122843 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf457j8k\" (UID: \"6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" Jul 08 17:45:02.123626 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:02.123603 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t9rt\" (UniqueName: \"kubernetes.io/projected/6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a-kube-api-access-9t9rt\") pod \"data-science-gateway-data-science-gateway-class-6576859cf457j8k\" (UID: \"6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" Jul 08 17:45:02.160596 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:02.160497 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:45:02.217660 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:02.217632 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" Jul 08 17:45:02.320746 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:02.320711 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:45:02.360753 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:02.360722 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k"] Jul 08 17:45:02.364172 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:45:02.364142 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c3fcbb5_7ab3_4cee_82fc_9ba77d98f34a.slice/crio-5f369f32c4db922e49a955488c02758a2c1667f841eb8b19f0cd6f68d5265a56 WatchSource:0}: Error finding container 5f369f32c4db922e49a955488c02758a2c1667f841eb8b19f0cd6f68d5265a56: Status 404 returned error can't find the container with id 5f369f32c4db922e49a955488c02758a2c1667f841eb8b19f0cd6f68d5265a56 Jul 08 17:45:03.256972 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:03.256935 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" event={"ID":"6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a","Type":"ContainerStarted","Data":"5f369f32c4db922e49a955488c02758a2c1667f841eb8b19f0cd6f68d5265a56"} Jul 08 17:45:05.858257 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:05.858217 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 17:45:05.858491 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:05.858292 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 17:45:05.858491 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:05.858322 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 17:45:06.275125 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:06.275088 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" event={"ID":"6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a","Type":"ContainerStarted","Data":"f1768626ac5273ce4600c80043b94da352d4d2c8722322b63cd08f6cff2cdde5"} Jul 08 17:45:06.300646 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:06.300596 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" podStartSLOduration=1.809080706 podStartE2EDuration="5.300579548s" totalImagesPullingTime="3.491498842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:45:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:45:06.299871563 +0000 UTC m=+704.536263817" watchObservedRunningTime="2026-07-08 17:45:06.300579548 +0000 UTC m=+704.536971802" Jul 08 17:45:07.218321 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:07.218287 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" Jul 08 17:45:07.222891 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:07.222868 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" Jul 08 17:45:07.280644 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:07.280614 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" Jul 08 17:45:07.281588 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:07.281569 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf457j8k" Jul 08 17:45:44.810871 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:44.810831 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:45:44.899610 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:44.899577 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zck7m"] Jul 08 17:45:44.906558 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:44.906521 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zck7m" Jul 08 17:45:44.909608 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:44.909336 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 17:45:44.909608 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:44.909358 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-zdmdg\"" Jul 08 17:45:44.910176 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:44.910152 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 17:45:44.916790 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:44.916727 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zck7m"] Jul 08 17:45:44.957252 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:44.957225 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4pnz\" (UniqueName: \"kubernetes.io/projected/495aa8a3-5e15-44d5-88d1-da9aa34e8f50-kube-api-access-v4pnz\") pod \"kuadrant-operator-catalog-zck7m\" (UID: \"495aa8a3-5e15-44d5-88d1-da9aa34e8f50\") " pod="kuadrant-system/kuadrant-operator-catalog-zck7m" Jul 08 17:45:45.058679 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:45.058651 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4pnz\" (UniqueName: \"kubernetes.io/projected/495aa8a3-5e15-44d5-88d1-da9aa34e8f50-kube-api-access-v4pnz\") pod \"kuadrant-operator-catalog-zck7m\" (UID: \"495aa8a3-5e15-44d5-88d1-da9aa34e8f50\") " pod="kuadrant-system/kuadrant-operator-catalog-zck7m" Jul 08 17:45:45.067348 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:45.067291 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4pnz\" (UniqueName: \"kubernetes.io/projected/495aa8a3-5e15-44d5-88d1-da9aa34e8f50-kube-api-access-v4pnz\") pod \"kuadrant-operator-catalog-zck7m\" (UID: \"495aa8a3-5e15-44d5-88d1-da9aa34e8f50\") " pod="kuadrant-system/kuadrant-operator-catalog-zck7m" Jul 08 17:45:45.229708 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:45.229663 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zck7m" Jul 08 17:45:45.363649 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:45.363623 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zck7m"] Jul 08 17:45:45.365264 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:45:45.365244 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod495aa8a3_5e15_44d5_88d1_da9aa34e8f50.slice/crio-6298d4502bda8dd3c1677539ba9bc5a22dcf09f2f872fe8e4c60512c706ecf70 WatchSource:0}: Error finding container 6298d4502bda8dd3c1677539ba9bc5a22dcf09f2f872fe8e4c60512c706ecf70: Status 404 returned error can't find the container with id 6298d4502bda8dd3c1677539ba9bc5a22dcf09f2f872fe8e4c60512c706ecf70 Jul 08 17:45:45.451377 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:45.451347 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zck7m" event={"ID":"495aa8a3-5e15-44d5-88d1-da9aa34e8f50","Type":"ContainerStarted","Data":"6298d4502bda8dd3c1677539ba9bc5a22dcf09f2f872fe8e4c60512c706ecf70"} Jul 08 17:45:46.732774 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:46.732737 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:45:47.465062 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:47.465024 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zck7m" event={"ID":"495aa8a3-5e15-44d5-88d1-da9aa34e8f50","Type":"ContainerStarted","Data":"ac251ef4d51347e517ed2e535b9790837fba779bf18397197a4eb575d1035aac"} Jul 08 17:45:47.482510 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:47.482460 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-zck7m" podStartSLOduration=1.611762959 podStartE2EDuration="3.482443208s" totalImagesPullingTime="1.870680249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:45:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:45:47.481335112 +0000 UTC m=+745.717727361" watchObservedRunningTime="2026-07-08 17:45:47.482443208 +0000 UTC m=+745.718835480" Jul 08 17:45:55.230494 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:55.230450 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-zck7m" Jul 08 17:45:55.230938 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:55.230516 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-zck7m" Jul 08 17:45:55.253661 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:55.253636 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-zck7m" Jul 08 17:45:55.522006 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:55.521936 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-zck7m" Jul 08 17:45:58.783568 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:58.783521 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q"] Jul 08 17:45:58.786379 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:58.786359 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q" Jul 08 17:45:58.788946 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:58.788928 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2h78s\"" Jul 08 17:45:58.802973 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:58.802949 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q"] Jul 08 17:45:58.879619 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:58.879584 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76a09a05-b454-46ed-9250-69e07de573f8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q\" (UID: \"76a09a05-b454-46ed-9250-69e07de573f8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q" Jul 08 17:45:58.879775 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:58.879681 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76a09a05-b454-46ed-9250-69e07de573f8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q\" (UID: \"76a09a05-b454-46ed-9250-69e07de573f8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q" Jul 08 17:45:58.879775 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:58.879710 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxs4c\" (UniqueName: \"kubernetes.io/projected/76a09a05-b454-46ed-9250-69e07de573f8-kube-api-access-qxs4c\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q\" (UID: \"76a09a05-b454-46ed-9250-69e07de573f8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q" Jul 08 17:45:58.980445 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:58.980404 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxs4c\" (UniqueName: \"kubernetes.io/projected/76a09a05-b454-46ed-9250-69e07de573f8-kube-api-access-qxs4c\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q\" (UID: \"76a09a05-b454-46ed-9250-69e07de573f8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q" Jul 08 17:45:58.980445 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:58.980448 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76a09a05-b454-46ed-9250-69e07de573f8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q\" (UID: \"76a09a05-b454-46ed-9250-69e07de573f8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q" Jul 08 17:45:58.980690 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:58.980509 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76a09a05-b454-46ed-9250-69e07de573f8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q\" (UID: \"76a09a05-b454-46ed-9250-69e07de573f8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q" Jul 08 17:45:58.980969 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:58.980947 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76a09a05-b454-46ed-9250-69e07de573f8-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q\" (UID: \"76a09a05-b454-46ed-9250-69e07de573f8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q" Jul 08 17:45:58.981009 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:58.980957 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76a09a05-b454-46ed-9250-69e07de573f8-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q\" (UID: \"76a09a05-b454-46ed-9250-69e07de573f8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q" Jul 08 17:45:58.988477 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:58.988448 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxs4c\" (UniqueName: \"kubernetes.io/projected/76a09a05-b454-46ed-9250-69e07de573f8-kube-api-access-qxs4c\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q\" (UID: \"76a09a05-b454-46ed-9250-69e07de573f8\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q" Jul 08 17:45:59.101866 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:59.101791 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q" Jul 08 17:45:59.233468 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:59.233422 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q"] Jul 08 17:45:59.235761 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:45:59.235734 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76a09a05_b454_46ed_9250_69e07de573f8.slice/crio-5d17978ca76d1b62c3a742129bb0b98627c3513c441cd9cae1d3acf75dd64473 WatchSource:0}: Error finding container 5d17978ca76d1b62c3a742129bb0b98627c3513c441cd9cae1d3acf75dd64473: Status 404 returned error can't find the container with id 5d17978ca76d1b62c3a742129bb0b98627c3513c441cd9cae1d3acf75dd64473 Jul 08 17:45:59.518686 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:59.518653 2552 generic.go:356] "Generic (PLEG): container finished" podID="76a09a05-b454-46ed-9250-69e07de573f8" containerID="69565b3c69f92e8ab3dd888ab69ab48af3350dedb95fc89653e54529cec6cc75" exitCode=0 Jul 08 17:45:59.518856 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:59.518736 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q" event={"ID":"76a09a05-b454-46ed-9250-69e07de573f8","Type":"ContainerDied","Data":"69565b3c69f92e8ab3dd888ab69ab48af3350dedb95fc89653e54529cec6cc75"} Jul 08 17:45:59.518856 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:59.518796 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q" event={"ID":"76a09a05-b454-46ed-9250-69e07de573f8","Type":"ContainerStarted","Data":"5d17978ca76d1b62c3a742129bb0b98627c3513c441cd9cae1d3acf75dd64473"} Jul 08 17:45:59.543226 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:59.543201 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd"] Jul 08 17:45:59.545807 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:59.545791 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd" Jul 08 17:45:59.556696 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:59.556674 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd"] Jul 08 17:45:59.686218 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:59.686184 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28b489c6-2209-4551-9b1a-9708251da0ff-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd\" (UID: \"28b489c6-2209-4551-9b1a-9708251da0ff\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd" Jul 08 17:45:59.686369 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:59.686223 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mlbg\" (UniqueName: \"kubernetes.io/projected/28b489c6-2209-4551-9b1a-9708251da0ff-kube-api-access-4mlbg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd\" (UID: \"28b489c6-2209-4551-9b1a-9708251da0ff\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd" Jul 08 17:45:59.686369 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:59.686250 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28b489c6-2209-4551-9b1a-9708251da0ff-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd\" (UID: \"28b489c6-2209-4551-9b1a-9708251da0ff\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd" Jul 08 17:45:59.769002 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:59.768908 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:45:59.787333 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:59.787309 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28b489c6-2209-4551-9b1a-9708251da0ff-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd\" (UID: \"28b489c6-2209-4551-9b1a-9708251da0ff\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd" Jul 08 17:45:59.787661 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:59.787345 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mlbg\" (UniqueName: \"kubernetes.io/projected/28b489c6-2209-4551-9b1a-9708251da0ff-kube-api-access-4mlbg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd\" (UID: \"28b489c6-2209-4551-9b1a-9708251da0ff\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd" Jul 08 17:45:59.787661 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:59.787370 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28b489c6-2209-4551-9b1a-9708251da0ff-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd\" (UID: \"28b489c6-2209-4551-9b1a-9708251da0ff\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd" Jul 08 17:45:59.787731 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:59.787695 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28b489c6-2209-4551-9b1a-9708251da0ff-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd\" (UID: \"28b489c6-2209-4551-9b1a-9708251da0ff\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd" Jul 08 17:45:59.787731 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:59.787715 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28b489c6-2209-4551-9b1a-9708251da0ff-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd\" (UID: \"28b489c6-2209-4551-9b1a-9708251da0ff\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd" Jul 08 17:45:59.796349 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:59.796330 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mlbg\" (UniqueName: \"kubernetes.io/projected/28b489c6-2209-4551-9b1a-9708251da0ff-kube-api-access-4mlbg\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd\" (UID: \"28b489c6-2209-4551-9b1a-9708251da0ff\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd" Jul 08 17:45:59.855304 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:59.855282 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd" Jul 08 17:45:59.996497 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:45:59.996472 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd"] Jul 08 17:45:59.998916 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:45:59.998874 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28b489c6_2209_4551_9b1a_9708251da0ff.slice/crio-d03ce979d08b5399cb27b7d7d6bc8a0e5656ace2129cf848e507eb368369848e WatchSource:0}: Error finding container d03ce979d08b5399cb27b7d7d6bc8a0e5656ace2129cf848e507eb368369848e: Status 404 returned error can't find the container with id d03ce979d08b5399cb27b7d7d6bc8a0e5656ace2129cf848e507eb368369848e Jul 08 17:46:00.140951 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:00.140924 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz"] Jul 08 17:46:00.143310 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:00.143295 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz" Jul 08 17:46:00.152394 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:00.152370 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz"] Jul 08 17:46:00.191409 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:00.191379 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4da1d754-e7b9-440d-a83f-cc2eb4df56c0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz\" (UID: \"4da1d754-e7b9-440d-a83f-cc2eb4df56c0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz" Jul 08 17:46:00.191590 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:00.191416 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g95lv\" (UniqueName: \"kubernetes.io/projected/4da1d754-e7b9-440d-a83f-cc2eb4df56c0-kube-api-access-g95lv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz\" (UID: \"4da1d754-e7b9-440d-a83f-cc2eb4df56c0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz" Jul 08 17:46:00.191590 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:00.191439 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4da1d754-e7b9-440d-a83f-cc2eb4df56c0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz\" (UID: \"4da1d754-e7b9-440d-a83f-cc2eb4df56c0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz" Jul 08 17:46:00.292937 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:00.292886 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4da1d754-e7b9-440d-a83f-cc2eb4df56c0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz\" (UID: \"4da1d754-e7b9-440d-a83f-cc2eb4df56c0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz" Jul 08 17:46:00.292937 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:00.292920 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g95lv\" (UniqueName: \"kubernetes.io/projected/4da1d754-e7b9-440d-a83f-cc2eb4df56c0-kube-api-access-g95lv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz\" (UID: \"4da1d754-e7b9-440d-a83f-cc2eb4df56c0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz" Jul 08 17:46:00.293079 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:00.292946 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4da1d754-e7b9-440d-a83f-cc2eb4df56c0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz\" (UID: \"4da1d754-e7b9-440d-a83f-cc2eb4df56c0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz" Jul 08 17:46:00.293309 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:00.293289 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4da1d754-e7b9-440d-a83f-cc2eb4df56c0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz\" (UID: \"4da1d754-e7b9-440d-a83f-cc2eb4df56c0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz" Jul 08 17:46:00.293344 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:00.293302 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4da1d754-e7b9-440d-a83f-cc2eb4df56c0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz\" (UID: \"4da1d754-e7b9-440d-a83f-cc2eb4df56c0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz" Jul 08 17:46:00.302490 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:00.302468 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g95lv\" (UniqueName: \"kubernetes.io/projected/4da1d754-e7b9-440d-a83f-cc2eb4df56c0-kube-api-access-g95lv\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz\" (UID: \"4da1d754-e7b9-440d-a83f-cc2eb4df56c0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz" Jul 08 17:46:00.487866 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:00.487836 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz" Jul 08 17:46:00.524409 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:00.524376 2552 generic.go:356] "Generic (PLEG): container finished" podID="28b489c6-2209-4551-9b1a-9708251da0ff" containerID="b777daba75a9528b1ca5183afce0245b8cda6c6189863ddc6c93fa42ad8af4d4" exitCode=0 Jul 08 17:46:00.524614 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:00.524464 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd" event={"ID":"28b489c6-2209-4551-9b1a-9708251da0ff","Type":"ContainerDied","Data":"b777daba75a9528b1ca5183afce0245b8cda6c6189863ddc6c93fa42ad8af4d4"} Jul 08 17:46:00.524614 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:00.524519 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd" event={"ID":"28b489c6-2209-4551-9b1a-9708251da0ff","Type":"ContainerStarted","Data":"d03ce979d08b5399cb27b7d7d6bc8a0e5656ace2129cf848e507eb368369848e"} Jul 08 17:46:00.527294 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:00.526426 2552 generic.go:356] "Generic (PLEG): container finished" podID="76a09a05-b454-46ed-9250-69e07de573f8" containerID="b7d5d24aed401271b55ab1574dec3fd0d9b1dd79244d4af9896e01eb1657dce7" exitCode=0 Jul 08 17:46:00.527294 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:00.526515 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q" event={"ID":"76a09a05-b454-46ed-9250-69e07de573f8","Type":"ContainerDied","Data":"b7d5d24aed401271b55ab1574dec3fd0d9b1dd79244d4af9896e01eb1657dce7"} Jul 08 17:46:00.631468 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:00.631447 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz"] Jul 08 17:46:00.633319 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:46:00.633294 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4da1d754_e7b9_440d_a83f_cc2eb4df56c0.slice/crio-edab0be61253da0cc3b6d8d18fc226120ddeb5bf24da010aeef59e116d3d381c WatchSource:0}: Error finding container edab0be61253da0cc3b6d8d18fc226120ddeb5bf24da010aeef59e116d3d381c: Status 404 returned error can't find the container with id edab0be61253da0cc3b6d8d18fc226120ddeb5bf24da010aeef59e116d3d381c Jul 08 17:46:00.730152 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:00.730123 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz"] Jul 08 17:46:00.733161 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:00.733146 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz" Jul 08 17:46:00.741430 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:00.741398 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz"] Jul 08 17:46:00.798095 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:00.798013 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c7c90ea-47a9-460f-8207-8f64130b9a96-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz\" (UID: \"3c7c90ea-47a9-460f-8207-8f64130b9a96\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz" Jul 08 17:46:00.798095 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:00.798063 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c7c90ea-47a9-460f-8207-8f64130b9a96-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz\" (UID: \"3c7c90ea-47a9-460f-8207-8f64130b9a96\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz" Jul 08 17:46:00.798488 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:00.798178 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf2pc\" (UniqueName: \"kubernetes.io/projected/3c7c90ea-47a9-460f-8207-8f64130b9a96-kube-api-access-zf2pc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz\" (UID: \"3c7c90ea-47a9-460f-8207-8f64130b9a96\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz" Jul 08 17:46:00.899516 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:00.899479 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c7c90ea-47a9-460f-8207-8f64130b9a96-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz\" (UID: \"3c7c90ea-47a9-460f-8207-8f64130b9a96\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz" Jul 08 17:46:00.899723 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:00.899563 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c7c90ea-47a9-460f-8207-8f64130b9a96-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz\" (UID: \"3c7c90ea-47a9-460f-8207-8f64130b9a96\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz" Jul 08 17:46:00.899723 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:00.899642 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf2pc\" (UniqueName: \"kubernetes.io/projected/3c7c90ea-47a9-460f-8207-8f64130b9a96-kube-api-access-zf2pc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz\" (UID: \"3c7c90ea-47a9-460f-8207-8f64130b9a96\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz" Jul 08 17:46:00.899961 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:00.899937 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c7c90ea-47a9-460f-8207-8f64130b9a96-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz\" (UID: \"3c7c90ea-47a9-460f-8207-8f64130b9a96\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz" Jul 08 17:46:00.900032 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:00.899979 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c7c90ea-47a9-460f-8207-8f64130b9a96-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz\" (UID: \"3c7c90ea-47a9-460f-8207-8f64130b9a96\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz" Jul 08 17:46:00.907841 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:00.907810 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf2pc\" (UniqueName: \"kubernetes.io/projected/3c7c90ea-47a9-460f-8207-8f64130b9a96-kube-api-access-zf2pc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz\" (UID: \"3c7c90ea-47a9-460f-8207-8f64130b9a96\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz" Jul 08 17:46:01.054352 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:01.054268 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz" Jul 08 17:46:01.185208 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:01.185181 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz"] Jul 08 17:46:01.187064 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:46:01.187038 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c7c90ea_47a9_460f_8207_8f64130b9a96.slice/crio-709f0e24ca5719780c68ccec46568efc5ade10e6fe8fd0472b3ad43a1ee01ed5 WatchSource:0}: Error finding container 709f0e24ca5719780c68ccec46568efc5ade10e6fe8fd0472b3ad43a1ee01ed5: Status 404 returned error can't find the container with id 709f0e24ca5719780c68ccec46568efc5ade10e6fe8fd0472b3ad43a1ee01ed5 Jul 08 17:46:01.532477 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:01.532442 2552 generic.go:356] "Generic (PLEG): container finished" podID="4da1d754-e7b9-440d-a83f-cc2eb4df56c0" containerID="062a28370ae8fb1617c02c205c8fa9aa340a505866037f9f39dbe331ab5b6a62" exitCode=0 Jul 08 17:46:01.532656 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:01.532529 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz" event={"ID":"4da1d754-e7b9-440d-a83f-cc2eb4df56c0","Type":"ContainerDied","Data":"062a28370ae8fb1617c02c205c8fa9aa340a505866037f9f39dbe331ab5b6a62"} Jul 08 17:46:01.532656 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:01.532604 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz" event={"ID":"4da1d754-e7b9-440d-a83f-cc2eb4df56c0","Type":"ContainerStarted","Data":"edab0be61253da0cc3b6d8d18fc226120ddeb5bf24da010aeef59e116d3d381c"} Jul 08 17:46:01.534900 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:01.534881 2552 generic.go:356] "Generic (PLEG): container finished" podID="76a09a05-b454-46ed-9250-69e07de573f8" containerID="0c8e28233ede1aa6e6dcb1ab350564a9c19d6bf99dcb90eca69af126c2ab5f5b" exitCode=0 Jul 08 17:46:01.534973 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:01.534958 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q" event={"ID":"76a09a05-b454-46ed-9250-69e07de573f8","Type":"ContainerDied","Data":"0c8e28233ede1aa6e6dcb1ab350564a9c19d6bf99dcb90eca69af126c2ab5f5b"} Jul 08 17:46:01.536361 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:01.536341 2552 generic.go:356] "Generic (PLEG): container finished" podID="3c7c90ea-47a9-460f-8207-8f64130b9a96" containerID="9d95cee3f054c17735040750097e8a241d2c1401c5a2657278c5c0376ec7f61d" exitCode=0 Jul 08 17:46:01.536468 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:01.536367 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz" event={"ID":"3c7c90ea-47a9-460f-8207-8f64130b9a96","Type":"ContainerDied","Data":"9d95cee3f054c17735040750097e8a241d2c1401c5a2657278c5c0376ec7f61d"} Jul 08 17:46:01.536468 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:01.536392 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz" event={"ID":"3c7c90ea-47a9-460f-8207-8f64130b9a96","Type":"ContainerStarted","Data":"709f0e24ca5719780c68ccec46568efc5ade10e6fe8fd0472b3ad43a1ee01ed5"} Jul 08 17:46:02.543799 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:02.543767 2552 generic.go:356] "Generic (PLEG): container finished" podID="28b489c6-2209-4551-9b1a-9708251da0ff" containerID="4c6ce44ea06ab055e84416e85d7ff8740a5e2aefb1f509cf04462187f65dc470" exitCode=0 Jul 08 17:46:02.544165 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:02.543867 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd" event={"ID":"28b489c6-2209-4551-9b1a-9708251da0ff","Type":"ContainerDied","Data":"4c6ce44ea06ab055e84416e85d7ff8740a5e2aefb1f509cf04462187f65dc470"} Jul 08 17:46:02.695607 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:02.695581 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q" Jul 08 17:46:02.817844 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:02.817788 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76a09a05-b454-46ed-9250-69e07de573f8-bundle\") pod \"76a09a05-b454-46ed-9250-69e07de573f8\" (UID: \"76a09a05-b454-46ed-9250-69e07de573f8\") " Jul 08 17:46:02.817951 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:02.817900 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76a09a05-b454-46ed-9250-69e07de573f8-util\") pod \"76a09a05-b454-46ed-9250-69e07de573f8\" (UID: \"76a09a05-b454-46ed-9250-69e07de573f8\") " Jul 08 17:46:02.818005 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:02.817974 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxs4c\" (UniqueName: \"kubernetes.io/projected/76a09a05-b454-46ed-9250-69e07de573f8-kube-api-access-qxs4c\") pod \"76a09a05-b454-46ed-9250-69e07de573f8\" (UID: \"76a09a05-b454-46ed-9250-69e07de573f8\") " Jul 08 17:46:02.818341 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:02.818314 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76a09a05-b454-46ed-9250-69e07de573f8-bundle" (OuterVolumeSpecName: "bundle") pod "76a09a05-b454-46ed-9250-69e07de573f8" (UID: "76a09a05-b454-46ed-9250-69e07de573f8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:46:02.820221 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:02.820196 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76a09a05-b454-46ed-9250-69e07de573f8-kube-api-access-qxs4c" (OuterVolumeSpecName: "kube-api-access-qxs4c") pod "76a09a05-b454-46ed-9250-69e07de573f8" (UID: "76a09a05-b454-46ed-9250-69e07de573f8"). InnerVolumeSpecName "kube-api-access-qxs4c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:46:02.823715 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:02.823692 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76a09a05-b454-46ed-9250-69e07de573f8-util" (OuterVolumeSpecName: "util") pod "76a09a05-b454-46ed-9250-69e07de573f8" (UID: "76a09a05-b454-46ed-9250-69e07de573f8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:46:02.918619 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:02.918597 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76a09a05-b454-46ed-9250-69e07de573f8-util\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 17:46:02.918719 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:02.918621 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxs4c\" (UniqueName: \"kubernetes.io/projected/76a09a05-b454-46ed-9250-69e07de573f8-kube-api-access-qxs4c\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 17:46:02.918719 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:02.918635 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76a09a05-b454-46ed-9250-69e07de573f8-bundle\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 17:46:03.551081 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:03.551054 2552 generic.go:356] "Generic (PLEG): container finished" podID="28b489c6-2209-4551-9b1a-9708251da0ff" containerID="e53e85362fc44467dceb04a0c274e0a16d6a76860e5c0c1a7cbc6ff37b4cdf3b" exitCode=0 Jul 08 17:46:03.551428 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:03.551133 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd" event={"ID":"28b489c6-2209-4551-9b1a-9708251da0ff","Type":"ContainerDied","Data":"e53e85362fc44467dceb04a0c274e0a16d6a76860e5c0c1a7cbc6ff37b4cdf3b"} Jul 08 17:46:03.553453 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:03.553430 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q" Jul 08 17:46:03.553453 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:03.553443 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q" event={"ID":"76a09a05-b454-46ed-9250-69e07de573f8","Type":"ContainerDied","Data":"5d17978ca76d1b62c3a742129bb0b98627c3513c441cd9cae1d3acf75dd64473"} Jul 08 17:46:03.553628 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:03.553485 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d17978ca76d1b62c3a742129bb0b98627c3513c441cd9cae1d3acf75dd64473" Jul 08 17:46:03.555497 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:03.555480 2552 generic.go:356] "Generic (PLEG): container finished" podID="3c7c90ea-47a9-460f-8207-8f64130b9a96" containerID="220ae99e0ecbc2ac06f4531796cc2fa78ddeed5ef15456ca425d4d450cdadcb9" exitCode=0 Jul 08 17:46:03.555608 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:03.555503 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz" event={"ID":"3c7c90ea-47a9-460f-8207-8f64130b9a96","Type":"ContainerDied","Data":"220ae99e0ecbc2ac06f4531796cc2fa78ddeed5ef15456ca425d4d450cdadcb9"} Jul 08 17:46:03.558067 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:03.558045 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz" event={"ID":"4da1d754-e7b9-440d-a83f-cc2eb4df56c0","Type":"ContainerStarted","Data":"434c8fec649cf6c8ca7e8a38b35228079ee0c127c430930715e62e0183211ca5"} Jul 08 17:46:04.565474 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:04.565429 2552 generic.go:356] "Generic (PLEG): container finished" podID="3c7c90ea-47a9-460f-8207-8f64130b9a96" containerID="7db313be96161965943f548e6700c3840018a6069d1cf100dcbbe3f76205dad6" exitCode=0 Jul 08 17:46:04.565965 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:04.565506 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz" event={"ID":"3c7c90ea-47a9-460f-8207-8f64130b9a96","Type":"ContainerDied","Data":"7db313be96161965943f548e6700c3840018a6069d1cf100dcbbe3f76205dad6"} Jul 08 17:46:04.567209 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:04.567181 2552 generic.go:356] "Generic (PLEG): container finished" podID="4da1d754-e7b9-440d-a83f-cc2eb4df56c0" containerID="434c8fec649cf6c8ca7e8a38b35228079ee0c127c430930715e62e0183211ca5" exitCode=0 Jul 08 17:46:04.567326 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:04.567267 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz" event={"ID":"4da1d754-e7b9-440d-a83f-cc2eb4df56c0","Type":"ContainerDied","Data":"434c8fec649cf6c8ca7e8a38b35228079ee0c127c430930715e62e0183211ca5"} Jul 08 17:46:04.758615 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:04.758588 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd" Jul 08 17:46:04.835253 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:04.835173 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mlbg\" (UniqueName: \"kubernetes.io/projected/28b489c6-2209-4551-9b1a-9708251da0ff-kube-api-access-4mlbg\") pod \"28b489c6-2209-4551-9b1a-9708251da0ff\" (UID: \"28b489c6-2209-4551-9b1a-9708251da0ff\") " Jul 08 17:46:04.835253 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:04.835220 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28b489c6-2209-4551-9b1a-9708251da0ff-util\") pod \"28b489c6-2209-4551-9b1a-9708251da0ff\" (UID: \"28b489c6-2209-4551-9b1a-9708251da0ff\") " Jul 08 17:46:04.835253 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:04.835255 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28b489c6-2209-4551-9b1a-9708251da0ff-bundle\") pod \"28b489c6-2209-4551-9b1a-9708251da0ff\" (UID: \"28b489c6-2209-4551-9b1a-9708251da0ff\") " Jul 08 17:46:04.835789 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:04.835765 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28b489c6-2209-4551-9b1a-9708251da0ff-bundle" (OuterVolumeSpecName: "bundle") pod "28b489c6-2209-4551-9b1a-9708251da0ff" (UID: "28b489c6-2209-4551-9b1a-9708251da0ff"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:46:04.837481 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:04.837454 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28b489c6-2209-4551-9b1a-9708251da0ff-kube-api-access-4mlbg" (OuterVolumeSpecName: "kube-api-access-4mlbg") pod "28b489c6-2209-4551-9b1a-9708251da0ff" (UID: "28b489c6-2209-4551-9b1a-9708251da0ff"). InnerVolumeSpecName "kube-api-access-4mlbg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:46:04.840627 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:04.840607 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28b489c6-2209-4551-9b1a-9708251da0ff-util" (OuterVolumeSpecName: "util") pod "28b489c6-2209-4551-9b1a-9708251da0ff" (UID: "28b489c6-2209-4551-9b1a-9708251da0ff"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:46:04.936184 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:04.936155 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mlbg\" (UniqueName: \"kubernetes.io/projected/28b489c6-2209-4551-9b1a-9708251da0ff-kube-api-access-4mlbg\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 17:46:04.936184 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:04.936181 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28b489c6-2209-4551-9b1a-9708251da0ff-util\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 17:46:04.936184 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:04.936190 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28b489c6-2209-4551-9b1a-9708251da0ff-bundle\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 17:46:05.574041 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:05.574007 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd" Jul 08 17:46:05.574453 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:05.574016 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd" event={"ID":"28b489c6-2209-4551-9b1a-9708251da0ff","Type":"ContainerDied","Data":"d03ce979d08b5399cb27b7d7d6bc8a0e5656ace2129cf848e507eb368369848e"} Jul 08 17:46:05.574453 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:05.574135 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d03ce979d08b5399cb27b7d7d6bc8a0e5656ace2129cf848e507eb368369848e" Jul 08 17:46:05.576231 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:05.576206 2552 generic.go:356] "Generic (PLEG): container finished" podID="4da1d754-e7b9-440d-a83f-cc2eb4df56c0" containerID="da9262c4f91f5c64fd94ee0884165881af86eaa08263cf5e0b6f6726d43f3c3d" exitCode=0 Jul 08 17:46:05.576365 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:05.576230 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz" event={"ID":"4da1d754-e7b9-440d-a83f-cc2eb4df56c0","Type":"ContainerDied","Data":"da9262c4f91f5c64fd94ee0884165881af86eaa08263cf5e0b6f6726d43f3c3d"} Jul 08 17:46:05.707352 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:05.707330 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz" Jul 08 17:46:05.844336 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:05.844252 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zf2pc\" (UniqueName: \"kubernetes.io/projected/3c7c90ea-47a9-460f-8207-8f64130b9a96-kube-api-access-zf2pc\") pod \"3c7c90ea-47a9-460f-8207-8f64130b9a96\" (UID: \"3c7c90ea-47a9-460f-8207-8f64130b9a96\") " Jul 08 17:46:05.844336 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:05.844323 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c7c90ea-47a9-460f-8207-8f64130b9a96-util\") pod \"3c7c90ea-47a9-460f-8207-8f64130b9a96\" (UID: \"3c7c90ea-47a9-460f-8207-8f64130b9a96\") " Jul 08 17:46:05.844593 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:05.844424 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c7c90ea-47a9-460f-8207-8f64130b9a96-bundle\") pod \"3c7c90ea-47a9-460f-8207-8f64130b9a96\" (UID: \"3c7c90ea-47a9-460f-8207-8f64130b9a96\") " Jul 08 17:46:05.845076 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:05.845001 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c7c90ea-47a9-460f-8207-8f64130b9a96-bundle" (OuterVolumeSpecName: "bundle") pod "3c7c90ea-47a9-460f-8207-8f64130b9a96" (UID: "3c7c90ea-47a9-460f-8207-8f64130b9a96"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:46:05.846529 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:05.846508 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c7c90ea-47a9-460f-8207-8f64130b9a96-kube-api-access-zf2pc" (OuterVolumeSpecName: "kube-api-access-zf2pc") pod "3c7c90ea-47a9-460f-8207-8f64130b9a96" (UID: "3c7c90ea-47a9-460f-8207-8f64130b9a96"). InnerVolumeSpecName "kube-api-access-zf2pc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:46:05.849737 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:05.849712 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c7c90ea-47a9-460f-8207-8f64130b9a96-util" (OuterVolumeSpecName: "util") pod "3c7c90ea-47a9-460f-8207-8f64130b9a96" (UID: "3c7c90ea-47a9-460f-8207-8f64130b9a96"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:46:05.945187 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:05.945158 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zf2pc\" (UniqueName: \"kubernetes.io/projected/3c7c90ea-47a9-460f-8207-8f64130b9a96-kube-api-access-zf2pc\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 17:46:05.945187 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:05.945183 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c7c90ea-47a9-460f-8207-8f64130b9a96-util\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 17:46:05.945187 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:05.945195 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c7c90ea-47a9-460f-8207-8f64130b9a96-bundle\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 17:46:06.583013 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:06.582921 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz" event={"ID":"3c7c90ea-47a9-460f-8207-8f64130b9a96","Type":"ContainerDied","Data":"709f0e24ca5719780c68ccec46568efc5ade10e6fe8fd0472b3ad43a1ee01ed5"} Jul 08 17:46:06.583013 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:06.582976 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="709f0e24ca5719780c68ccec46568efc5ade10e6fe8fd0472b3ad43a1ee01ed5" Jul 08 17:46:06.583409 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:06.583090 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz" Jul 08 17:46:06.714016 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:06.713988 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz" Jul 08 17:46:06.853817 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:06.853712 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4da1d754-e7b9-440d-a83f-cc2eb4df56c0-util\") pod \"4da1d754-e7b9-440d-a83f-cc2eb4df56c0\" (UID: \"4da1d754-e7b9-440d-a83f-cc2eb4df56c0\") " Jul 08 17:46:06.853817 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:06.853799 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g95lv\" (UniqueName: \"kubernetes.io/projected/4da1d754-e7b9-440d-a83f-cc2eb4df56c0-kube-api-access-g95lv\") pod \"4da1d754-e7b9-440d-a83f-cc2eb4df56c0\" (UID: \"4da1d754-e7b9-440d-a83f-cc2eb4df56c0\") " Jul 08 17:46:06.854035 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:06.853840 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4da1d754-e7b9-440d-a83f-cc2eb4df56c0-bundle\") pod \"4da1d754-e7b9-440d-a83f-cc2eb4df56c0\" (UID: \"4da1d754-e7b9-440d-a83f-cc2eb4df56c0\") " Jul 08 17:46:06.854358 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:06.854325 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4da1d754-e7b9-440d-a83f-cc2eb4df56c0-bundle" (OuterVolumeSpecName: "bundle") pod "4da1d754-e7b9-440d-a83f-cc2eb4df56c0" (UID: "4da1d754-e7b9-440d-a83f-cc2eb4df56c0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:46:06.856029 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:06.856002 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4da1d754-e7b9-440d-a83f-cc2eb4df56c0-kube-api-access-g95lv" (OuterVolumeSpecName: "kube-api-access-g95lv") pod "4da1d754-e7b9-440d-a83f-cc2eb4df56c0" (UID: "4da1d754-e7b9-440d-a83f-cc2eb4df56c0"). InnerVolumeSpecName "kube-api-access-g95lv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:46:06.858245 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:06.858220 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4da1d754-e7b9-440d-a83f-cc2eb4df56c0-util" (OuterVolumeSpecName: "util") pod "4da1d754-e7b9-440d-a83f-cc2eb4df56c0" (UID: "4da1d754-e7b9-440d-a83f-cc2eb4df56c0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:46:06.954870 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:06.954821 2552 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4da1d754-e7b9-440d-a83f-cc2eb4df56c0-util\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 17:46:06.954870 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:06.954863 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g95lv\" (UniqueName: \"kubernetes.io/projected/4da1d754-e7b9-440d-a83f-cc2eb4df56c0-kube-api-access-g95lv\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 17:46:06.954870 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:06.954873 2552 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4da1d754-e7b9-440d-a83f-cc2eb4df56c0-bundle\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 17:46:07.588832 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:07.588796 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz" event={"ID":"4da1d754-e7b9-440d-a83f-cc2eb4df56c0","Type":"ContainerDied","Data":"edab0be61253da0cc3b6d8d18fc226120ddeb5bf24da010aeef59e116d3d381c"} Jul 08 17:46:07.588832 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:07.588832 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz" Jul 08 17:46:07.589330 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:07.588845 2552 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="edab0be61253da0cc3b6d8d18fc226120ddeb5bf24da010aeef59e116d3d381c" Jul 08 17:46:12.319106 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:12.319072 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:17.046586 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.046527 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:17.293709 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.293678 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znp4g"] Jul 08 17:46:17.294020 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.294008 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4da1d754-e7b9-440d-a83f-cc2eb4df56c0" containerName="util" Jul 08 17:46:17.294063 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.294025 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4da1d754-e7b9-440d-a83f-cc2eb4df56c0" containerName="util" Jul 08 17:46:17.294063 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.294037 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c7c90ea-47a9-460f-8207-8f64130b9a96" containerName="util" Jul 08 17:46:17.294063 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.294043 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c7c90ea-47a9-460f-8207-8f64130b9a96" containerName="util" Jul 08 17:46:17.294063 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.294050 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28b489c6-2209-4551-9b1a-9708251da0ff" containerName="extract" Jul 08 17:46:17.294063 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.294056 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="28b489c6-2209-4551-9b1a-9708251da0ff" containerName="extract" Jul 08 17:46:17.294063 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.294062 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4da1d754-e7b9-440d-a83f-cc2eb4df56c0" containerName="pull" Jul 08 17:46:17.294245 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.294067 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4da1d754-e7b9-440d-a83f-cc2eb4df56c0" containerName="pull" Jul 08 17:46:17.294245 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.294073 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28b489c6-2209-4551-9b1a-9708251da0ff" containerName="util" Jul 08 17:46:17.294245 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.294078 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="28b489c6-2209-4551-9b1a-9708251da0ff" containerName="util" Jul 08 17:46:17.294245 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.294084 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76a09a05-b454-46ed-9250-69e07de573f8" containerName="extract" Jul 08 17:46:17.294245 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.294090 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="76a09a05-b454-46ed-9250-69e07de573f8" containerName="extract" Jul 08 17:46:17.294245 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.294098 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c7c90ea-47a9-460f-8207-8f64130b9a96" containerName="pull" Jul 08 17:46:17.294245 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.294106 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c7c90ea-47a9-460f-8207-8f64130b9a96" containerName="pull" Jul 08 17:46:17.294245 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.294116 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28b489c6-2209-4551-9b1a-9708251da0ff" containerName="pull" Jul 08 17:46:17.294245 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.294120 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="28b489c6-2209-4551-9b1a-9708251da0ff" containerName="pull" Jul 08 17:46:17.294245 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.294128 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76a09a05-b454-46ed-9250-69e07de573f8" containerName="util" Jul 08 17:46:17.294245 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.294133 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="76a09a05-b454-46ed-9250-69e07de573f8" containerName="util" Jul 08 17:46:17.294245 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.294140 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76a09a05-b454-46ed-9250-69e07de573f8" containerName="pull" Jul 08 17:46:17.294245 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.294145 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="76a09a05-b454-46ed-9250-69e07de573f8" containerName="pull" Jul 08 17:46:17.294245 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.294153 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c7c90ea-47a9-460f-8207-8f64130b9a96" containerName="extract" Jul 08 17:46:17.294245 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.294157 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c7c90ea-47a9-460f-8207-8f64130b9a96" containerName="extract" Jul 08 17:46:17.294245 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.294165 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4da1d754-e7b9-440d-a83f-cc2eb4df56c0" containerName="extract" Jul 08 17:46:17.294245 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.294170 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="4da1d754-e7b9-440d-a83f-cc2eb4df56c0" containerName="extract" Jul 08 17:46:17.294245 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.294233 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="76a09a05-b454-46ed-9250-69e07de573f8" containerName="extract" Jul 08 17:46:17.294245 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.294241 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="4da1d754-e7b9-440d-a83f-cc2eb4df56c0" containerName="extract" Jul 08 17:46:17.294245 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.294247 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="28b489c6-2209-4551-9b1a-9708251da0ff" containerName="extract" Jul 08 17:46:17.294245 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.294251 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c7c90ea-47a9-460f-8207-8f64130b9a96" containerName="extract" Jul 08 17:46:17.297166 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.297126 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znp4g" Jul 08 17:46:17.300028 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.299999 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-bb4fd\"" Jul 08 17:46:17.309896 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.309874 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znp4g"] Jul 08 17:46:17.450395 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.450364 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-znp4g\" (UID: \"8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znp4g" Jul 08 17:46:17.450600 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.450433 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfpwl\" (UniqueName: \"kubernetes.io/projected/8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275-kube-api-access-mfpwl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-znp4g\" (UID: \"8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znp4g" Jul 08 17:46:17.550973 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.550897 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfpwl\" (UniqueName: \"kubernetes.io/projected/8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275-kube-api-access-mfpwl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-znp4g\" (UID: \"8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znp4g" Jul 08 17:46:17.550973 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.550957 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-znp4g\" (UID: \"8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znp4g" Jul 08 17:46:17.551271 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.551252 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-znp4g\" (UID: \"8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znp4g" Jul 08 17:46:17.559119 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.559096 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfpwl\" (UniqueName: \"kubernetes.io/projected/8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275-kube-api-access-mfpwl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-znp4g\" (UID: \"8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znp4g" Jul 08 17:46:17.607113 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.607088 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znp4g" Jul 08 17:46:17.741675 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.741650 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znp4g"] Jul 08 17:46:17.744087 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:46:17.744058 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c047e4d_3c09_4d1c_8c40_cf3b5ecc0275.slice/crio-caff918d9a53f1f82f63fe94935da595b38f03fde2fc6d6b9ba61ac0e9f0a1ed WatchSource:0}: Error finding container caff918d9a53f1f82f63fe94935da595b38f03fde2fc6d6b9ba61ac0e9f0a1ed: Status 404 returned error can't find the container with id caff918d9a53f1f82f63fe94935da595b38f03fde2fc6d6b9ba61ac0e9f0a1ed Jul 08 17:46:17.932950 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:17.932854 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:18.649288 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:18.649255 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znp4g" event={"ID":"8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275","Type":"ContainerStarted","Data":"caff918d9a53f1f82f63fe94935da595b38f03fde2fc6d6b9ba61ac0e9f0a1ed"} Jul 08 17:46:19.875418 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:19.875350 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:19.969103 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:19.969051 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:22.165668 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:22.165625 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:22.425865 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:22.425784 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:23.150959 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:23.150877 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:23.688927 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:23.688895 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znp4g" event={"ID":"8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275","Type":"ContainerStarted","Data":"661c30be3a630e756e5bee1407831b29cd706f4f30be4310d592f13217876ec1"} Jul 08 17:46:23.689319 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:23.689021 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znp4g" Jul 08 17:46:23.717049 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:23.717001 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znp4g" podStartSLOduration=1.718406931 podStartE2EDuration="6.716985828s" totalImagesPullingTime="4.998578897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:46:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:46:23.715969151 +0000 UTC m=+781.952361403" watchObservedRunningTime="2026-07-08 17:46:23.716985828 +0000 UTC m=+781.953378081" Jul 08 17:46:24.570521 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:24.570480 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:25.526012 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:25.525984 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-x4rg4"] Jul 08 17:46:25.529385 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:25.529367 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x4rg4" Jul 08 17:46:25.531656 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:25.531631 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 08 17:46:25.531835 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:25.531819 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2h78s\"" Jul 08 17:46:25.531915 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:25.531819 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 08 17:46:25.539172 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:25.539149 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:25.540205 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:25.540186 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-x4rg4"] Jul 08 17:46:25.626842 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:25.626792 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-g59th"] Jul 08 17:46:25.630427 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:25.630405 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g59th" Jul 08 17:46:25.634612 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:25.634591 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-7qw8n\"" Jul 08 17:46:25.641088 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:25.641068 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-g59th"] Jul 08 17:46:25.723868 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:25.723824 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq6q6\" (UniqueName: \"kubernetes.io/projected/64c1ad54-5e1e-44b3-9cc5-fdd94ee0677b-kube-api-access-cq6q6\") pod \"kuadrant-console-plugin-66b5774985-x4rg4\" (UID: \"64c1ad54-5e1e-44b3-9cc5-fdd94ee0677b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x4rg4" Jul 08 17:46:25.723868 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:25.723865 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/64c1ad54-5e1e-44b3-9cc5-fdd94ee0677b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-x4rg4\" (UID: \"64c1ad54-5e1e-44b3-9cc5-fdd94ee0677b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x4rg4" Jul 08 17:46:25.724113 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:25.723949 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/64c1ad54-5e1e-44b3-9cc5-fdd94ee0677b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-x4rg4\" (UID: \"64c1ad54-5e1e-44b3-9cc5-fdd94ee0677b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x4rg4" Jul 08 17:46:25.825235 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:25.825153 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq6wz\" (UniqueName: \"kubernetes.io/projected/66a40a61-8cdb-4172-bcde-baab112536f2-kube-api-access-bq6wz\") pod \"authorino-operator-75cc8d5cb7-g59th\" (UID: \"66a40a61-8cdb-4172-bcde-baab112536f2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-g59th" Jul 08 17:46:25.825235 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:25.825198 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq6q6\" (UniqueName: \"kubernetes.io/projected/64c1ad54-5e1e-44b3-9cc5-fdd94ee0677b-kube-api-access-cq6q6\") pod \"kuadrant-console-plugin-66b5774985-x4rg4\" (UID: \"64c1ad54-5e1e-44b3-9cc5-fdd94ee0677b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x4rg4" Jul 08 17:46:25.825235 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:25.825218 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/64c1ad54-5e1e-44b3-9cc5-fdd94ee0677b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-x4rg4\" (UID: \"64c1ad54-5e1e-44b3-9cc5-fdd94ee0677b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x4rg4" Jul 08 17:46:25.825444 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:25.825290 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/64c1ad54-5e1e-44b3-9cc5-fdd94ee0677b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-x4rg4\" (UID: \"64c1ad54-5e1e-44b3-9cc5-fdd94ee0677b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x4rg4" Jul 08 17:46:25.825444 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:46:25.825374 2552 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 08 17:46:25.825444 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:46:25.825435 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64c1ad54-5e1e-44b3-9cc5-fdd94ee0677b-plugin-serving-cert podName:64c1ad54-5e1e-44b3-9cc5-fdd94ee0677b nodeName:}" failed. No retries permitted until 2026-07-08 17:46:26.325416894 +0000 UTC m=+784.561809127 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/64c1ad54-5e1e-44b3-9cc5-fdd94ee0677b-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-x4rg4" (UID: "64c1ad54-5e1e-44b3-9cc5-fdd94ee0677b") : secret "plugin-serving-cert" not found Jul 08 17:46:25.825815 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:25.825797 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/64c1ad54-5e1e-44b3-9cc5-fdd94ee0677b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-x4rg4\" (UID: \"64c1ad54-5e1e-44b3-9cc5-fdd94ee0677b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x4rg4" Jul 08 17:46:25.835182 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:25.835157 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq6q6\" (UniqueName: \"kubernetes.io/projected/64c1ad54-5e1e-44b3-9cc5-fdd94ee0677b-kube-api-access-cq6q6\") pod \"kuadrant-console-plugin-66b5774985-x4rg4\" (UID: \"64c1ad54-5e1e-44b3-9cc5-fdd94ee0677b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x4rg4" Jul 08 17:46:25.926495 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:25.926463 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq6wz\" (UniqueName: \"kubernetes.io/projected/66a40a61-8cdb-4172-bcde-baab112536f2-kube-api-access-bq6wz\") pod \"authorino-operator-75cc8d5cb7-g59th\" (UID: \"66a40a61-8cdb-4172-bcde-baab112536f2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-g59th" Jul 08 17:46:25.935475 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:25.935438 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq6wz\" (UniqueName: \"kubernetes.io/projected/66a40a61-8cdb-4172-bcde-baab112536f2-kube-api-access-bq6wz\") pod \"authorino-operator-75cc8d5cb7-g59th\" (UID: \"66a40a61-8cdb-4172-bcde-baab112536f2\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-g59th" Jul 08 17:46:25.952033 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:25.952007 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g59th" Jul 08 17:46:26.089746 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:26.089720 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-g59th"] Jul 08 17:46:26.091428 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:46:26.091403 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66a40a61_8cdb_4172_bcde_baab112536f2.slice/crio-c099a8efeb2c72db15d435c0b8be6a4f28513bd199a11dcf40e14c8878817115 WatchSource:0}: Error finding container c099a8efeb2c72db15d435c0b8be6a4f28513bd199a11dcf40e14c8878817115: Status 404 returned error can't find the container with id c099a8efeb2c72db15d435c0b8be6a4f28513bd199a11dcf40e14c8878817115 Jul 08 17:46:26.151778 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:26.151744 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:26.330464 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:26.330432 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/64c1ad54-5e1e-44b3-9cc5-fdd94ee0677b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-x4rg4\" (UID: \"64c1ad54-5e1e-44b3-9cc5-fdd94ee0677b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x4rg4" Jul 08 17:46:26.332967 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:26.332940 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/64c1ad54-5e1e-44b3-9cc5-fdd94ee0677b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-x4rg4\" (UID: \"64c1ad54-5e1e-44b3-9cc5-fdd94ee0677b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x4rg4" Jul 08 17:46:26.439891 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:26.439809 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x4rg4" Jul 08 17:46:26.577302 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:26.577265 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-x4rg4"] Jul 08 17:46:26.578922 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:46:26.578893 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64c1ad54_5e1e_44b3_9cc5_fdd94ee0677b.slice/crio-51759b550e9f15a2451cdecaeed92900892005829a43831b7816e5e212f6539b WatchSource:0}: Error finding container 51759b550e9f15a2451cdecaeed92900892005829a43831b7816e5e212f6539b: Status 404 returned error can't find the container with id 51759b550e9f15a2451cdecaeed92900892005829a43831b7816e5e212f6539b Jul 08 17:46:26.705765 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:26.705735 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x4rg4" event={"ID":"64c1ad54-5e1e-44b3-9cc5-fdd94ee0677b","Type":"ContainerStarted","Data":"51759b550e9f15a2451cdecaeed92900892005829a43831b7816e5e212f6539b"} Jul 08 17:46:26.706817 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:26.706796 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g59th" event={"ID":"66a40a61-8cdb-4172-bcde-baab112536f2","Type":"ContainerStarted","Data":"c099a8efeb2c72db15d435c0b8be6a4f28513bd199a11dcf40e14c8878817115"} Jul 08 17:46:27.541124 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:27.541080 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:27.608752 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:27.608630 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:28.727965 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:28.727926 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g59th" event={"ID":"66a40a61-8cdb-4172-bcde-baab112536f2","Type":"ContainerStarted","Data":"4839fc80c684327ebd952c069cf918cb147cdd437efeaf75a1be7208770aa3ca"} Jul 08 17:46:28.728433 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:28.728332 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g59th" Jul 08 17:46:28.747438 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:28.747386 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g59th" podStartSLOduration=1.298675523 podStartE2EDuration="3.747366899s" totalImagesPullingTime="2.448691376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:46:28.746312739 +0000 UTC m=+786.982704993" watchObservedRunningTime="2026-07-08 17:46:28.747366899 +0000 UTC m=+786.983759152" Jul 08 17:46:34.696883 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:34.696844 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znp4g" Jul 08 17:46:35.266391 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:35.266338 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:35.372945 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:35.372906 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:36.455166 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:36.455131 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znp4g"] Jul 08 17:46:36.455662 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:36.455341 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znp4g" podUID="8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275" containerName="manager" containerID="cri-o://661c30be3a630e756e5bee1407831b29cd706f4f30be4310d592f13217876ec1" gracePeriod=2 Jul 08 17:46:36.459690 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:36.459629 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znp4g"] Jul 08 17:46:36.484221 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:36.484007 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgf2n"] Jul 08 17:46:36.484551 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:36.484518 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275" containerName="manager" Jul 08 17:46:36.484694 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:36.484680 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275" containerName="manager" Jul 08 17:46:36.484930 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:36.484916 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275" containerName="manager" Jul 08 17:46:36.488395 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:36.488370 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgf2n" Jul 08 17:46:36.490466 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:46:36.490439 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-znp4g\" is forbidden: User \"system:node:ip-10-0-130-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-38.ec2.internal' and this object" podUID="8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znp4g" Jul 08 17:46:36.500294 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:36.500264 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgf2n"] Jul 08 17:46:36.522807 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:36.522766 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q97lf\" (UniqueName: \"kubernetes.io/projected/30ea589a-9d0c-4a24-ba07-f0c2a183d71e-kube-api-access-q97lf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mgf2n\" (UID: \"30ea589a-9d0c-4a24-ba07-f0c2a183d71e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgf2n" Jul 08 17:46:36.522958 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:36.522823 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30ea589a-9d0c-4a24-ba07-f0c2a183d71e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mgf2n\" (UID: \"30ea589a-9d0c-4a24-ba07-f0c2a183d71e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgf2n" Jul 08 17:46:36.624075 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:36.624033 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q97lf\" (UniqueName: \"kubernetes.io/projected/30ea589a-9d0c-4a24-ba07-f0c2a183d71e-kube-api-access-q97lf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mgf2n\" (UID: \"30ea589a-9d0c-4a24-ba07-f0c2a183d71e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgf2n" Jul 08 17:46:36.624247 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:36.624099 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30ea589a-9d0c-4a24-ba07-f0c2a183d71e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mgf2n\" (UID: \"30ea589a-9d0c-4a24-ba07-f0c2a183d71e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgf2n" Jul 08 17:46:36.624559 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:36.624518 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30ea589a-9d0c-4a24-ba07-f0c2a183d71e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mgf2n\" (UID: \"30ea589a-9d0c-4a24-ba07-f0c2a183d71e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgf2n" Jul 08 17:46:36.633697 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:36.633673 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q97lf\" (UniqueName: \"kubernetes.io/projected/30ea589a-9d0c-4a24-ba07-f0c2a183d71e-kube-api-access-q97lf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-mgf2n\" (UID: \"30ea589a-9d0c-4a24-ba07-f0c2a183d71e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgf2n" Jul 08 17:46:36.740352 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:36.740265 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rw4g2"] Jul 08 17:46:36.743977 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:36.743948 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rw4g2" Jul 08 17:46:36.755815 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:36.755785 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rw4g2"] Jul 08 17:46:36.778902 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:46:36.778867 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-znp4g\" is forbidden: User \"system:node:ip-10-0-130-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-38.ec2.internal' and this object" podUID="8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znp4g" Jul 08 17:46:36.826009 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:36.825972 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2337f2a7-cdd3-493f-9cff-a56e229fccaf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rw4g2\" (UID: \"2337f2a7-cdd3-493f-9cff-a56e229fccaf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rw4g2" Jul 08 17:46:36.826185 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:36.826036 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj6fz\" (UniqueName: \"kubernetes.io/projected/2337f2a7-cdd3-493f-9cff-a56e229fccaf-kube-api-access-fj6fz\") pod \"kuadrant-operator-controller-manager-86878c769f-rw4g2\" (UID: \"2337f2a7-cdd3-493f-9cff-a56e229fccaf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rw4g2" Jul 08 17:46:36.840892 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:36.840859 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgf2n" Jul 08 17:46:36.927482 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:36.927442 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fj6fz\" (UniqueName: \"kubernetes.io/projected/2337f2a7-cdd3-493f-9cff-a56e229fccaf-kube-api-access-fj6fz\") pod \"kuadrant-operator-controller-manager-86878c769f-rw4g2\" (UID: \"2337f2a7-cdd3-493f-9cff-a56e229fccaf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rw4g2" Jul 08 17:46:36.927729 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:36.927618 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2337f2a7-cdd3-493f-9cff-a56e229fccaf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rw4g2\" (UID: \"2337f2a7-cdd3-493f-9cff-a56e229fccaf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rw4g2" Jul 08 17:46:36.928043 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:36.928005 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2337f2a7-cdd3-493f-9cff-a56e229fccaf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-rw4g2\" (UID: \"2337f2a7-cdd3-493f-9cff-a56e229fccaf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rw4g2" Jul 08 17:46:36.945045 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:36.945010 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj6fz\" (UniqueName: \"kubernetes.io/projected/2337f2a7-cdd3-493f-9cff-a56e229fccaf-kube-api-access-fj6fz\") pod \"kuadrant-operator-controller-manager-86878c769f-rw4g2\" (UID: \"2337f2a7-cdd3-493f-9cff-a56e229fccaf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rw4g2" Jul 08 17:46:37.057553 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:37.057458 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rw4g2" Jul 08 17:46:37.214711 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:37.214673 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:37.322519 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:37.322439 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:39.160861 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:39.160823 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:39.297183 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:39.297150 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:39.737440 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:39.737408 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-g59th" Jul 08 17:46:39.974895 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:39.974848 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:40.077613 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:40.077474 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:44.750321 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:44.750210 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:44.852261 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:44.852226 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:48.764354 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:48.764317 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:48.867922 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:48.867885 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:49.088369 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:49.088339 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znp4g" Jul 08 17:46:49.090998 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:46:49.090965 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-znp4g\" is forbidden: User \"system:node:ip-10-0-130-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-38.ec2.internal' and this object" podUID="8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znp4g" Jul 08 17:46:49.107179 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:49.107156 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgf2n"] Jul 08 17:46:49.109908 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:46:49.109884 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30ea589a_9d0c_4a24_ba07_f0c2a183d71e.slice/crio-6ccfad6dc07fbd0d4c743e3e539f567542d8135e1defd7b969ff359a530e7f51 WatchSource:0}: Error finding container 6ccfad6dc07fbd0d4c743e3e539f567542d8135e1defd7b969ff359a530e7f51: Status 404 returned error can't find the container with id 6ccfad6dc07fbd0d4c743e3e539f567542d8135e1defd7b969ff359a530e7f51 Jul 08 17:46:49.122050 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:49.121980 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rw4g2"] Jul 08 17:46:49.124269 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:46:49.124247 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2337f2a7_cdd3_493f_9cff_a56e229fccaf.slice/crio-9da313425e955ce9ed0b05f4a1888bc1fe2eb48420708cd9163f0e427810e9de WatchSource:0}: Error finding container 9da313425e955ce9ed0b05f4a1888bc1fe2eb48420708cd9163f0e427810e9de: Status 404 returned error can't find the container with id 9da313425e955ce9ed0b05f4a1888bc1fe2eb48420708cd9163f0e427810e9de Jul 08 17:46:49.142449 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:49.142430 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfpwl\" (UniqueName: \"kubernetes.io/projected/8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275-kube-api-access-mfpwl\") pod \"8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275\" (UID: \"8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275\") " Jul 08 17:46:49.142552 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:49.142524 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275-extensions-socket-volume\") pod \"8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275\" (UID: \"8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275\") " Jul 08 17:46:49.143049 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:49.143025 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275" (UID: "8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:46:49.144624 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:49.144595 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275-kube-api-access-mfpwl" (OuterVolumeSpecName: "kube-api-access-mfpwl") pod "8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275" (UID: "8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275"). InnerVolumeSpecName "kube-api-access-mfpwl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:46:49.243702 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:49.243668 2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275-extensions-socket-volume\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 17:46:49.243702 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:49.243693 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfpwl\" (UniqueName: \"kubernetes.io/projected/8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275-kube-api-access-mfpwl\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 17:46:49.862935 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:49.862882 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rw4g2" event={"ID":"2337f2a7-cdd3-493f-9cff-a56e229fccaf","Type":"ContainerStarted","Data":"687e3dfaddb27a1952f4798c93969e025623cd7d110a80c6b709a0e542a5c190"} Jul 08 17:46:49.863375 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:49.862989 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rw4g2" event={"ID":"2337f2a7-cdd3-493f-9cff-a56e229fccaf","Type":"ContainerStarted","Data":"9da313425e955ce9ed0b05f4a1888bc1fe2eb48420708cd9163f0e427810e9de"} Jul 08 17:46:49.863375 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:49.863024 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rw4g2" Jul 08 17:46:49.864195 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:49.864170 2552 generic.go:356] "Generic (PLEG): container finished" podID="8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275" containerID="661c30be3a630e756e5bee1407831b29cd706f4f30be4310d592f13217876ec1" exitCode=0 Jul 08 17:46:49.864323 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:49.864213 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znp4g" Jul 08 17:46:49.864323 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:49.864267 2552 scope.go:117] "RemoveContainer" containerID="661c30be3a630e756e5bee1407831b29cd706f4f30be4310d592f13217876ec1" Jul 08 17:46:49.864909 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:46:49.864883 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-znp4g\" is forbidden: User \"system:node:ip-10-0-130-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-38.ec2.internal' and this object" podUID="8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znp4g" Jul 08 17:46:49.865985 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:49.865960 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgf2n" event={"ID":"30ea589a-9d0c-4a24-ba07-f0c2a183d71e","Type":"ContainerStarted","Data":"faeb33f6c94bb9459c824807568eaac0560470b97be14174bd4411f19cb5db3d"} Jul 08 17:46:49.866092 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:49.866029 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgf2n" event={"ID":"30ea589a-9d0c-4a24-ba07-f0c2a183d71e","Type":"ContainerStarted","Data":"6ccfad6dc07fbd0d4c743e3e539f567542d8135e1defd7b969ff359a530e7f51"} Jul 08 17:46:49.866092 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:49.866063 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgf2n" Jul 08 17:46:49.867597 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:49.867578 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x4rg4" event={"ID":"64c1ad54-5e1e-44b3-9cc5-fdd94ee0677b","Type":"ContainerStarted","Data":"c6f59e95a65d3bb2991551b4be2be5892e36ebe02bf8c1180c7681d0b5ae0f98"} Jul 08 17:46:49.874474 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:49.874454 2552 scope.go:117] "RemoveContainer" containerID="661c30be3a630e756e5bee1407831b29cd706f4f30be4310d592f13217876ec1" Jul 08 17:46:49.874733 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:46:49.874716 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"661c30be3a630e756e5bee1407831b29cd706f4f30be4310d592f13217876ec1\": container with ID starting with 661c30be3a630e756e5bee1407831b29cd706f4f30be4310d592f13217876ec1 not found: ID does not exist" containerID="661c30be3a630e756e5bee1407831b29cd706f4f30be4310d592f13217876ec1" Jul 08 17:46:49.874803 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:49.874742 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"661c30be3a630e756e5bee1407831b29cd706f4f30be4310d592f13217876ec1"} err="failed to get container status \"661c30be3a630e756e5bee1407831b29cd706f4f30be4310d592f13217876ec1\": rpc error: code = NotFound desc = could not find container \"661c30be3a630e756e5bee1407831b29cd706f4f30be4310d592f13217876ec1\": container with ID starting with 661c30be3a630e756e5bee1407831b29cd706f4f30be4310d592f13217876ec1 not found: ID does not exist" Jul 08 17:46:49.886958 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:49.886883 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rw4g2" podStartSLOduration=13.886870539 podStartE2EDuration="13.886870539s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:46:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:46:49.885884995 +0000 UTC m=+808.122277250" watchObservedRunningTime="2026-07-08 17:46:49.886870539 +0000 UTC m=+808.123262795" Jul 08 17:46:49.887902 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:46:49.887875 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-znp4g\" is forbidden: User \"system:node:ip-10-0-130-38.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-38.ec2.internal' and this object" podUID="8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-znp4g" Jul 08 17:46:49.908846 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:49.908805 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x4rg4" podStartSLOduration=2.493009626 podStartE2EDuration="24.908789532s" totalImagesPullingTime="22.415779906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:46:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:46:49.906199256 +0000 UTC m=+808.142591519" watchObservedRunningTime="2026-07-08 17:46:49.908789532 +0000 UTC m=+808.145181787" Jul 08 17:46:49.932032 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:49.931978 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgf2n" podStartSLOduration=13.931955554 podStartE2EDuration="13.931955554s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:46:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:46:49.930763983 +0000 UTC m=+808.167156239" watchObservedRunningTime="2026-07-08 17:46:49.931955554 +0000 UTC m=+808.168347808" Jul 08 17:46:50.163387 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:50.163270 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:50.264331 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:50.264293 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:50.306140 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:50.306108 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275" path="/var/lib/kubelet/pods/8c047e4d-3c09-4d1c-8c40-cf3b5ecc0275/volumes" Jul 08 17:46:50.363858 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:50.363825 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:57.278147 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:57.278101 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:46:57.344594 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:46:57.344563 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:00.876313 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:00.876274 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgf2n" Jul 08 17:47:00.876720 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:00.876371 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rw4g2" Jul 08 17:47:00.958456 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:00.958415 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:00.958651 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:00.958463 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgf2n"] Jul 08 17:47:00.958816 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:00.958796 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgf2n" podUID="30ea589a-9d0c-4a24-ba07-f0c2a183d71e" containerName="manager" containerID="cri-o://faeb33f6c94bb9459c824807568eaac0560470b97be14174bd4411f19cb5db3d" gracePeriod=10 Jul 08 17:47:01.058171 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:01.058125 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:01.943854 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:01.943825 2552 generic.go:356] "Generic (PLEG): container finished" podID="30ea589a-9d0c-4a24-ba07-f0c2a183d71e" containerID="faeb33f6c94bb9459c824807568eaac0560470b97be14174bd4411f19cb5db3d" exitCode=0 Jul 08 17:47:01.944212 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:01.943904 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgf2n" event={"ID":"30ea589a-9d0c-4a24-ba07-f0c2a183d71e","Type":"ContainerDied","Data":"faeb33f6c94bb9459c824807568eaac0560470b97be14174bd4411f19cb5db3d"} Jul 08 17:47:02.380926 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:02.380904 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgf2n" Jul 08 17:47:02.556007 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:02.555938 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30ea589a-9d0c-4a24-ba07-f0c2a183d71e-extensions-socket-volume\") pod \"30ea589a-9d0c-4a24-ba07-f0c2a183d71e\" (UID: \"30ea589a-9d0c-4a24-ba07-f0c2a183d71e\") " Jul 08 17:47:02.556007 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:02.555976 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q97lf\" (UniqueName: \"kubernetes.io/projected/30ea589a-9d0c-4a24-ba07-f0c2a183d71e-kube-api-access-q97lf\") pod \"30ea589a-9d0c-4a24-ba07-f0c2a183d71e\" (UID: \"30ea589a-9d0c-4a24-ba07-f0c2a183d71e\") " Jul 08 17:47:02.556352 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:02.556328 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30ea589a-9d0c-4a24-ba07-f0c2a183d71e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "30ea589a-9d0c-4a24-ba07-f0c2a183d71e" (UID: "30ea589a-9d0c-4a24-ba07-f0c2a183d71e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:47:02.558172 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:02.558154 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30ea589a-9d0c-4a24-ba07-f0c2a183d71e-kube-api-access-q97lf" (OuterVolumeSpecName: "kube-api-access-q97lf") pod "30ea589a-9d0c-4a24-ba07-f0c2a183d71e" (UID: "30ea589a-9d0c-4a24-ba07-f0c2a183d71e"). InnerVolumeSpecName "kube-api-access-q97lf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:47:02.657580 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:02.657547 2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/30ea589a-9d0c-4a24-ba07-f0c2a183d71e-extensions-socket-volume\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 17:47:02.657580 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:02.657571 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q97lf\" (UniqueName: \"kubernetes.io/projected/30ea589a-9d0c-4a24-ba07-f0c2a183d71e-kube-api-access-q97lf\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 17:47:02.950737 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:02.950708 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgf2n" event={"ID":"30ea589a-9d0c-4a24-ba07-f0c2a183d71e","Type":"ContainerDied","Data":"6ccfad6dc07fbd0d4c743e3e539f567542d8135e1defd7b969ff359a530e7f51"} Jul 08 17:47:02.950737 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:02.950732 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgf2n" Jul 08 17:47:02.951162 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:02.950762 2552 scope.go:117] "RemoveContainer" containerID="faeb33f6c94bb9459c824807568eaac0560470b97be14174bd4411f19cb5db3d" Jul 08 17:47:02.972133 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:02.972111 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgf2n"] Jul 08 17:47:02.976361 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:02.976338 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-mgf2n"] Jul 08 17:47:04.306654 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:04.306625 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30ea589a-9d0c-4a24-ba07-f0c2a183d71e" path="/var/lib/kubelet/pods/30ea589a-9d0c-4a24-ba07-f0c2a183d71e/volumes" Jul 08 17:47:05.357593 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:05.357516 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:05.421480 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:05.421436 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:05.542254 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:05.542213 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:05.642864 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:05.642775 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:17.391186 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:17.391140 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:17.613920 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:17.613883 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:22.176411 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:22.176364 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:22.277641 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:22.277601 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:22.376976 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:22.376941 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:22.998843 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:22.998799 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-8pq4c"] Jul 08 17:47:22.999193 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:22.999179 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30ea589a-9d0c-4a24-ba07-f0c2a183d71e" containerName="manager" Jul 08 17:47:22.999238 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:22.999196 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="30ea589a-9d0c-4a24-ba07-f0c2a183d71e" containerName="manager" Jul 08 17:47:22.999273 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:22.999269 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="30ea589a-9d0c-4a24-ba07-f0c2a183d71e" containerName="manager" Jul 08 17:47:23.019637 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:23.019603 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-8pq4c"] Jul 08 17:47:23.019774 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:23.019693 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8pq4c" Jul 08 17:47:23.022169 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:23.022151 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-wmcqs\"" Jul 08 17:47:23.037852 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:23.037825 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:23.101807 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:23.101783 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:23.119721 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:23.119691 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-f6b47"] Jul 08 17:47:23.123452 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:23.123434 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-f6b47" Jul 08 17:47:23.123725 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:23.123705 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct6s4\" (UniqueName: \"kubernetes.io/projected/feca7c73-15bc-434c-a6a2-525b9861cf13-kube-api-access-ct6s4\") pod \"authorino-58cd955675-8pq4c\" (UID: \"feca7c73-15bc-434c-a6a2-525b9861cf13\") " pod="kuadrant-system/authorino-58cd955675-8pq4c" Jul 08 17:47:23.128813 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:23.128790 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-f6b47"] Jul 08 17:47:23.224840 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:23.224800 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct6s4\" (UniqueName: \"kubernetes.io/projected/feca7c73-15bc-434c-a6a2-525b9861cf13-kube-api-access-ct6s4\") pod \"authorino-58cd955675-8pq4c\" (UID: \"feca7c73-15bc-434c-a6a2-525b9861cf13\") " pod="kuadrant-system/authorino-58cd955675-8pq4c" Jul 08 17:47:23.225204 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:23.224868 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x496g\" (UniqueName: \"kubernetes.io/projected/1448f94f-dff2-4582-8681-6b062b965e07-kube-api-access-x496g\") pod \"authorino-75d556bd77-f6b47\" (UID: \"1448f94f-dff2-4582-8681-6b062b965e07\") " pod="kuadrant-system/authorino-75d556bd77-f6b47" Jul 08 17:47:23.236463 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:23.236438 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct6s4\" (UniqueName: \"kubernetes.io/projected/feca7c73-15bc-434c-a6a2-525b9861cf13-kube-api-access-ct6s4\") pod \"authorino-58cd955675-8pq4c\" (UID: \"feca7c73-15bc-434c-a6a2-525b9861cf13\") " pod="kuadrant-system/authorino-58cd955675-8pq4c" Jul 08 17:47:23.325588 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:23.325516 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x496g\" (UniqueName: \"kubernetes.io/projected/1448f94f-dff2-4582-8681-6b062b965e07-kube-api-access-x496g\") pod \"authorino-75d556bd77-f6b47\" (UID: \"1448f94f-dff2-4582-8681-6b062b965e07\") " pod="kuadrant-system/authorino-75d556bd77-f6b47" Jul 08 17:47:23.329432 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:23.329413 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8pq4c" Jul 08 17:47:23.333842 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:23.333820 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x496g\" (UniqueName: \"kubernetes.io/projected/1448f94f-dff2-4582-8681-6b062b965e07-kube-api-access-x496g\") pod \"authorino-75d556bd77-f6b47\" (UID: \"1448f94f-dff2-4582-8681-6b062b965e07\") " pod="kuadrant-system/authorino-75d556bd77-f6b47" Jul 08 17:47:23.434075 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:23.434037 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-f6b47" Jul 08 17:47:23.465218 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:23.465189 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-8pq4c"] Jul 08 17:47:23.466382 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:47:23.466360 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfeca7c73_15bc_434c_a6a2_525b9861cf13.slice/crio-9e8593edaa9bdd7ba08a825f28753c2c28303874f7b934c8cbb6a766e01cbc22 WatchSource:0}: Error finding container 9e8593edaa9bdd7ba08a825f28753c2c28303874f7b934c8cbb6a766e01cbc22: Status 404 returned error can't find the container with id 9e8593edaa9bdd7ba08a825f28753c2c28303874f7b934c8cbb6a766e01cbc22 Jul 08 17:47:23.570142 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:23.570116 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-f6b47"] Jul 08 17:47:23.572046 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:47:23.572016 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1448f94f_dff2_4582_8681_6b062b965e07.slice/crio-ba8303e687c36fff686e2a4e5578088bfa91f09d5bb5abed6b97fea230c0beed WatchSource:0}: Error finding container ba8303e687c36fff686e2a4e5578088bfa91f09d5bb5abed6b97fea230c0beed: Status 404 returned error can't find the container with id ba8303e687c36fff686e2a4e5578088bfa91f09d5bb5abed6b97fea230c0beed Jul 08 17:47:24.066284 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:24.066251 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-f6b47" event={"ID":"1448f94f-dff2-4582-8681-6b062b965e07","Type":"ContainerStarted","Data":"ba8303e687c36fff686e2a4e5578088bfa91f09d5bb5abed6b97fea230c0beed"} Jul 08 17:47:24.067345 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:24.067320 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8pq4c" event={"ID":"feca7c73-15bc-434c-a6a2-525b9861cf13","Type":"ContainerStarted","Data":"9e8593edaa9bdd7ba08a825f28753c2c28303874f7b934c8cbb6a766e01cbc22"} Jul 08 17:47:28.093813 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:28.093768 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-f6b47" event={"ID":"1448f94f-dff2-4582-8681-6b062b965e07","Type":"ContainerStarted","Data":"2d5fd87773eae2b9f63d247c6379111077b994dd24e3e6d6091ff7eadee1c76e"} Jul 08 17:47:28.101440 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:28.101407 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8pq4c" event={"ID":"feca7c73-15bc-434c-a6a2-525b9861cf13","Type":"ContainerStarted","Data":"b4670d535529e8b315bbe0a1b4ccaaed43b873c0bd4a255cb6743b54955d5eee"} Jul 08 17:47:28.109879 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:28.109836 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-f6b47" podStartSLOduration=1.6018552929999998 podStartE2EDuration="5.109822838s" totalImagesPullingTime="3.507967545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:47:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:47:28.108848611 +0000 UTC m=+846.345240863" watchObservedRunningTime="2026-07-08 17:47:28.109822838 +0000 UTC m=+846.346215069" Jul 08 17:47:28.124203 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:28.124155 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-8pq4c" podStartSLOduration=2.498706507 podStartE2EDuration="6.124141276s" totalImagesPullingTime="3.625434769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:47:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:47:28.122397149 +0000 UTC m=+846.358789402" watchObservedRunningTime="2026-07-08 17:47:28.124141276 +0000 UTC m=+846.360533528" Jul 08 17:47:28.151418 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:28.151389 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-8pq4c"] Jul 08 17:47:30.110914 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:30.110875 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-8pq4c" podUID="feca7c73-15bc-434c-a6a2-525b9861cf13" containerName="authorino" containerID="cri-o://b4670d535529e8b315bbe0a1b4ccaaed43b873c0bd4a255cb6743b54955d5eee" gracePeriod=30 Jul 08 17:47:30.364003 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:30.363943 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8pq4c" Jul 08 17:47:30.488846 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:30.488814 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ct6s4\" (UniqueName: \"kubernetes.io/projected/feca7c73-15bc-434c-a6a2-525b9861cf13-kube-api-access-ct6s4\") pod \"feca7c73-15bc-434c-a6a2-525b9861cf13\" (UID: \"feca7c73-15bc-434c-a6a2-525b9861cf13\") " Jul 08 17:47:30.491112 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:30.491081 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/feca7c73-15bc-434c-a6a2-525b9861cf13-kube-api-access-ct6s4" (OuterVolumeSpecName: "kube-api-access-ct6s4") pod "feca7c73-15bc-434c-a6a2-525b9861cf13" (UID: "feca7c73-15bc-434c-a6a2-525b9861cf13"). InnerVolumeSpecName "kube-api-access-ct6s4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:47:30.589692 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:30.589648 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ct6s4\" (UniqueName: \"kubernetes.io/projected/feca7c73-15bc-434c-a6a2-525b9861cf13-kube-api-access-ct6s4\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 17:47:31.117266 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:31.117232 2552 generic.go:356] "Generic (PLEG): container finished" podID="feca7c73-15bc-434c-a6a2-525b9861cf13" containerID="b4670d535529e8b315bbe0a1b4ccaaed43b873c0bd4a255cb6743b54955d5eee" exitCode=0 Jul 08 17:47:31.117680 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:31.117272 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8pq4c" Jul 08 17:47:31.117680 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:31.117305 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8pq4c" event={"ID":"feca7c73-15bc-434c-a6a2-525b9861cf13","Type":"ContainerDied","Data":"b4670d535529e8b315bbe0a1b4ccaaed43b873c0bd4a255cb6743b54955d5eee"} Jul 08 17:47:31.117680 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:31.117347 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8pq4c" event={"ID":"feca7c73-15bc-434c-a6a2-525b9861cf13","Type":"ContainerDied","Data":"9e8593edaa9bdd7ba08a825f28753c2c28303874f7b934c8cbb6a766e01cbc22"} Jul 08 17:47:31.117680 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:31.117368 2552 scope.go:117] "RemoveContainer" containerID="b4670d535529e8b315bbe0a1b4ccaaed43b873c0bd4a255cb6743b54955d5eee" Jul 08 17:47:31.127138 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:31.127121 2552 scope.go:117] "RemoveContainer" containerID="b4670d535529e8b315bbe0a1b4ccaaed43b873c0bd4a255cb6743b54955d5eee" Jul 08 17:47:31.127405 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:47:31.127384 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4670d535529e8b315bbe0a1b4ccaaed43b873c0bd4a255cb6743b54955d5eee\": container with ID starting with b4670d535529e8b315bbe0a1b4ccaaed43b873c0bd4a255cb6743b54955d5eee not found: ID does not exist" containerID="b4670d535529e8b315bbe0a1b4ccaaed43b873c0bd4a255cb6743b54955d5eee" Jul 08 17:47:31.127452 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:31.127415 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4670d535529e8b315bbe0a1b4ccaaed43b873c0bd4a255cb6743b54955d5eee"} err="failed to get container status \"b4670d535529e8b315bbe0a1b4ccaaed43b873c0bd4a255cb6743b54955d5eee\": rpc error: code = NotFound desc = could not find container \"b4670d535529e8b315bbe0a1b4ccaaed43b873c0bd4a255cb6743b54955d5eee\": container with ID starting with b4670d535529e8b315bbe0a1b4ccaaed43b873c0bd4a255cb6743b54955d5eee not found: ID does not exist" Jul 08 17:47:31.155959 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:31.155934 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-8pq4c"] Jul 08 17:47:31.178836 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:31.178809 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-8pq4c"] Jul 08 17:47:32.306050 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:32.306019 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="feca7c73-15bc-434c-a6a2-525b9861cf13" path="/var/lib/kubelet/pods/feca7c73-15bc-434c-a6a2-525b9861cf13/volumes" Jul 08 17:47:38.333161 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:38.333130 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:38.428993 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:38.428956 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:38.841091 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:38.841051 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:51.210243 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:51.210209 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:51.453250 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:51.453219 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:51.688516 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:51.688439 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7956df6549-s8jb4"] Jul 08 17:47:51.688810 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:51.688797 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feca7c73-15bc-434c-a6a2-525b9861cf13" containerName="authorino" Jul 08 17:47:51.688856 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:51.688812 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="feca7c73-15bc-434c-a6a2-525b9861cf13" containerName="authorino" Jul 08 17:47:51.688890 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:51.688875 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="feca7c73-15bc-434c-a6a2-525b9861cf13" containerName="authorino" Jul 08 17:47:51.690820 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:51.690801 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7956df6549-s8jb4" Jul 08 17:47:51.699475 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:51.699449 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7956df6549-s8jb4"] Jul 08 17:47:51.767515 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:51.767473 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7956df6549-s8jb4"] Jul 08 17:47:51.767793 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:47:51.767771 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-dwrdr], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-7956df6549-s8jb4" podUID="6dc3d3a7-61be-4097-b924-45c9c49e28d9" Jul 08 17:47:51.772397 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:51.772369 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwrdr\" (UniqueName: \"kubernetes.io/projected/6dc3d3a7-61be-4097-b924-45c9c49e28d9-kube-api-access-dwrdr\") pod \"authorino-7956df6549-s8jb4\" (UID: \"6dc3d3a7-61be-4097-b924-45c9c49e28d9\") " pod="kuadrant-system/authorino-7956df6549-s8jb4" Jul 08 17:47:51.798599 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:51.798564 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557ff8454f-7z2fz"] Jul 08 17:47:51.801126 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:51.801104 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557ff8454f-7z2fz" Jul 08 17:47:51.803809 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:51.803789 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 08 17:47:51.812184 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:51.812160 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557ff8454f-7z2fz"] Jul 08 17:47:51.873877 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:51.873840 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwrdr\" (UniqueName: \"kubernetes.io/projected/6dc3d3a7-61be-4097-b924-45c9c49e28d9-kube-api-access-dwrdr\") pod \"authorino-7956df6549-s8jb4\" (UID: \"6dc3d3a7-61be-4097-b924-45c9c49e28d9\") " pod="kuadrant-system/authorino-7956df6549-s8jb4" Jul 08 17:47:51.873877 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:51.873878 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/77435991-4cbe-45ca-88cc-1a629c1d57ad-tls-cert\") pod \"authorino-557ff8454f-7z2fz\" (UID: \"77435991-4cbe-45ca-88cc-1a629c1d57ad\") " pod="kuadrant-system/authorino-557ff8454f-7z2fz" Jul 08 17:47:51.874090 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:51.873936 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxrrv\" (UniqueName: \"kubernetes.io/projected/77435991-4cbe-45ca-88cc-1a629c1d57ad-kube-api-access-zxrrv\") pod \"authorino-557ff8454f-7z2fz\" (UID: \"77435991-4cbe-45ca-88cc-1a629c1d57ad\") " pod="kuadrant-system/authorino-557ff8454f-7z2fz" Jul 08 17:47:51.884094 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:51.884060 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwrdr\" (UniqueName: \"kubernetes.io/projected/6dc3d3a7-61be-4097-b924-45c9c49e28d9-kube-api-access-dwrdr\") pod \"authorino-7956df6549-s8jb4\" (UID: \"6dc3d3a7-61be-4097-b924-45c9c49e28d9\") " pod="kuadrant-system/authorino-7956df6549-s8jb4" Jul 08 17:47:51.975375 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:51.975336 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxrrv\" (UniqueName: \"kubernetes.io/projected/77435991-4cbe-45ca-88cc-1a629c1d57ad-kube-api-access-zxrrv\") pod \"authorino-557ff8454f-7z2fz\" (UID: \"77435991-4cbe-45ca-88cc-1a629c1d57ad\") " pod="kuadrant-system/authorino-557ff8454f-7z2fz" Jul 08 17:47:51.975590 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:51.975418 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/77435991-4cbe-45ca-88cc-1a629c1d57ad-tls-cert\") pod \"authorino-557ff8454f-7z2fz\" (UID: \"77435991-4cbe-45ca-88cc-1a629c1d57ad\") " pod="kuadrant-system/authorino-557ff8454f-7z2fz" Jul 08 17:47:51.978011 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:51.977984 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/77435991-4cbe-45ca-88cc-1a629c1d57ad-tls-cert\") pod \"authorino-557ff8454f-7z2fz\" (UID: \"77435991-4cbe-45ca-88cc-1a629c1d57ad\") " pod="kuadrant-system/authorino-557ff8454f-7z2fz" Jul 08 17:47:51.984463 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:51.984442 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxrrv\" (UniqueName: \"kubernetes.io/projected/77435991-4cbe-45ca-88cc-1a629c1d57ad-kube-api-access-zxrrv\") pod \"authorino-557ff8454f-7z2fz\" (UID: \"77435991-4cbe-45ca-88cc-1a629c1d57ad\") " pod="kuadrant-system/authorino-557ff8454f-7z2fz" Jul 08 17:47:52.110761 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:52.110731 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557ff8454f-7z2fz" Jul 08 17:47:52.229079 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:52.229005 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7956df6549-s8jb4" Jul 08 17:47:52.237719 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:52.237691 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7956df6549-s8jb4" Jul 08 17:47:52.249435 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:52.249362 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557ff8454f-7z2fz"] Jul 08 17:47:52.252318 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:47:52.252285 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77435991_4cbe_45ca_88cc_1a629c1d57ad.slice/crio-d18068617e638da98edc5247fe218580562ed024ad637bc1c6ad6890c58c939d WatchSource:0}: Error finding container d18068617e638da98edc5247fe218580562ed024ad637bc1c6ad6890c58c939d: Status 404 returned error can't find the container with id d18068617e638da98edc5247fe218580562ed024ad637bc1c6ad6890c58c939d Jul 08 17:47:52.378712 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:52.378682 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dwrdr\" (UniqueName: \"kubernetes.io/projected/6dc3d3a7-61be-4097-b924-45c9c49e28d9-kube-api-access-dwrdr\") pod \"6dc3d3a7-61be-4097-b924-45c9c49e28d9\" (UID: \"6dc3d3a7-61be-4097-b924-45c9c49e28d9\") " Jul 08 17:47:52.380843 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:52.380816 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dc3d3a7-61be-4097-b924-45c9c49e28d9-kube-api-access-dwrdr" (OuterVolumeSpecName: "kube-api-access-dwrdr") pod "6dc3d3a7-61be-4097-b924-45c9c49e28d9" (UID: "6dc3d3a7-61be-4097-b924-45c9c49e28d9"). InnerVolumeSpecName "kube-api-access-dwrdr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:47:52.480130 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:52.480057 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dwrdr\" (UniqueName: \"kubernetes.io/projected/6dc3d3a7-61be-4097-b924-45c9c49e28d9-kube-api-access-dwrdr\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 17:47:53.235800 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:53.235768 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557ff8454f-7z2fz" event={"ID":"77435991-4cbe-45ca-88cc-1a629c1d57ad","Type":"ContainerStarted","Data":"d20bbfc978d3182313923512b88aae974b8d0eb78966dee11a374d6b6ed4ae36"} Jul 08 17:47:53.235800 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:53.235805 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557ff8454f-7z2fz" event={"ID":"77435991-4cbe-45ca-88cc-1a629c1d57ad","Type":"ContainerStarted","Data":"d18068617e638da98edc5247fe218580562ed024ad637bc1c6ad6890c58c939d"} Jul 08 17:47:53.236192 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:53.235871 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7956df6549-s8jb4" Jul 08 17:47:53.255711 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:53.255672 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-557ff8454f-7z2fz" podStartSLOduration=1.9269372809999998 podStartE2EDuration="2.255657277s" totalImagesPullingTime="328.719996ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:47:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:47:53.254387317 +0000 UTC m=+871.490779560" watchObservedRunningTime="2026-07-08 17:47:53.255657277 +0000 UTC m=+871.492049531" Jul 08 17:47:53.297877 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:53.297840 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7956df6549-s8jb4"] Jul 08 17:47:53.299827 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:53.299798 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7956df6549-s8jb4"] Jul 08 17:47:53.301580 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:53.301561 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-f6b47"] Jul 08 17:47:53.301720 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:53.301700 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-f6b47" podUID="1448f94f-dff2-4582-8681-6b062b965e07" containerName="authorino" containerID="cri-o://2d5fd87773eae2b9f63d247c6379111077b994dd24e3e6d6091ff7eadee1c76e" gracePeriod=30 Jul 08 17:47:53.545686 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:53.545658 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-f6b47" Jul 08 17:47:53.691092 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:53.691057 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x496g\" (UniqueName: \"kubernetes.io/projected/1448f94f-dff2-4582-8681-6b062b965e07-kube-api-access-x496g\") pod \"1448f94f-dff2-4582-8681-6b062b965e07\" (UID: \"1448f94f-dff2-4582-8681-6b062b965e07\") " Jul 08 17:47:53.693322 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:53.693290 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1448f94f-dff2-4582-8681-6b062b965e07-kube-api-access-x496g" (OuterVolumeSpecName: "kube-api-access-x496g") pod "1448f94f-dff2-4582-8681-6b062b965e07" (UID: "1448f94f-dff2-4582-8681-6b062b965e07"). InnerVolumeSpecName "kube-api-access-x496g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:47:53.792565 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:53.792467 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x496g\" (UniqueName: \"kubernetes.io/projected/1448f94f-dff2-4582-8681-6b062b965e07-kube-api-access-x496g\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 17:47:54.242255 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:54.242226 2552 generic.go:356] "Generic (PLEG): container finished" podID="1448f94f-dff2-4582-8681-6b062b965e07" containerID="2d5fd87773eae2b9f63d247c6379111077b994dd24e3e6d6091ff7eadee1c76e" exitCode=0 Jul 08 17:47:54.242652 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:54.242265 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-f6b47" Jul 08 17:47:54.242652 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:54.242318 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-f6b47" event={"ID":"1448f94f-dff2-4582-8681-6b062b965e07","Type":"ContainerDied","Data":"2d5fd87773eae2b9f63d247c6379111077b994dd24e3e6d6091ff7eadee1c76e"} Jul 08 17:47:54.242652 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:54.242361 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-f6b47" event={"ID":"1448f94f-dff2-4582-8681-6b062b965e07","Type":"ContainerDied","Data":"ba8303e687c36fff686e2a4e5578088bfa91f09d5bb5abed6b97fea230c0beed"} Jul 08 17:47:54.242652 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:54.242379 2552 scope.go:117] "RemoveContainer" containerID="2d5fd87773eae2b9f63d247c6379111077b994dd24e3e6d6091ff7eadee1c76e" Jul 08 17:47:54.252882 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:54.252863 2552 scope.go:117] "RemoveContainer" containerID="2d5fd87773eae2b9f63d247c6379111077b994dd24e3e6d6091ff7eadee1c76e" Jul 08 17:47:54.253263 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:47:54.253195 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d5fd87773eae2b9f63d247c6379111077b994dd24e3e6d6091ff7eadee1c76e\": container with ID starting with 2d5fd87773eae2b9f63d247c6379111077b994dd24e3e6d6091ff7eadee1c76e not found: ID does not exist" containerID="2d5fd87773eae2b9f63d247c6379111077b994dd24e3e6d6091ff7eadee1c76e" Jul 08 17:47:54.253263 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:54.253231 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d5fd87773eae2b9f63d247c6379111077b994dd24e3e6d6091ff7eadee1c76e"} err="failed to get container status \"2d5fd87773eae2b9f63d247c6379111077b994dd24e3e6d6091ff7eadee1c76e\": rpc error: code = NotFound desc = could not find container \"2d5fd87773eae2b9f63d247c6379111077b994dd24e3e6d6091ff7eadee1c76e\": container with ID starting with 2d5fd87773eae2b9f63d247c6379111077b994dd24e3e6d6091ff7eadee1c76e not found: ID does not exist" Jul 08 17:47:54.271331 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:54.271307 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-f6b47"] Jul 08 17:47:54.277210 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:54.277189 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-f6b47"] Jul 08 17:47:54.306226 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:54.306200 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1448f94f-dff2-4582-8681-6b062b965e07" path="/var/lib/kubelet/pods/1448f94f-dff2-4582-8681-6b062b965e07/volumes" Jul 08 17:47:54.306558 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:54.306524 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6dc3d3a7-61be-4097-b924-45c9c49e28d9" path="/var/lib/kubelet/pods/6dc3d3a7-61be-4097-b924-45c9c49e28d9/volumes" Jul 08 17:47:58.009294 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:58.009258 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:58.090153 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:58.090123 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:58.192350 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:58.192316 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:47:58.274858 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:47:58.274769 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:48:01.251547 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:48:01.251511 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:48:01.353509 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:48:01.353473 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:48:22.248451 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:48:22.248358 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-mnhqg_058a4314-4829-4b3d-a275-477b305bcf91/console-operator/1.log" Jul 08 17:48:22.249373 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:48:22.249354 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-mnhqg_058a4314-4829-4b3d-a275-477b305bcf91/console-operator/1.log" Jul 08 17:48:33.637013 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:48:33.636954 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:48:34.042028 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:48:34.041967 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:48:34.472880 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:48:34.472827 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:48:34.570633 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:48:34.570601 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:48:34.577948 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:48:34.577922 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-ns4kf"] Jul 08 17:48:34.578250 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:48:34.578239 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1448f94f-dff2-4582-8681-6b062b965e07" containerName="authorino" Jul 08 17:48:34.578301 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:48:34.578252 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="1448f94f-dff2-4582-8681-6b062b965e07" containerName="authorino" Jul 08 17:48:34.578348 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:48:34.578337 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="1448f94f-dff2-4582-8681-6b062b965e07" containerName="authorino" Jul 08 17:48:34.582607 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:48:34.582588 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-ns4kf" Jul 08 17:48:34.584882 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:48:34.584862 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 08 17:48:34.591159 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:48:34.591139 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-ns4kf"] Jul 08 17:48:34.613598 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:48:34.613577 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tcp9\" (UniqueName: \"kubernetes.io/projected/2378db08-f17a-4cf9-8071-418c81fc9665-kube-api-access-5tcp9\") pod \"payload-pre-processing-7964457696-ns4kf\" (UID: \"2378db08-f17a-4cf9-8071-418c81fc9665\") " pod="openshift-ingress/payload-pre-processing-7964457696-ns4kf" Jul 08 17:48:34.613714 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:48:34.613611 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2378db08-f17a-4cf9-8071-418c81fc9665-plugins-config-volume\") pod \"payload-pre-processing-7964457696-ns4kf\" (UID: \"2378db08-f17a-4cf9-8071-418c81fc9665\") " pod="openshift-ingress/payload-pre-processing-7964457696-ns4kf" Jul 08 17:48:34.652650 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:48:34.652610 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:48:34.714846 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:48:34.714813 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tcp9\" (UniqueName: \"kubernetes.io/projected/2378db08-f17a-4cf9-8071-418c81fc9665-kube-api-access-5tcp9\") pod \"payload-pre-processing-7964457696-ns4kf\" (UID: \"2378db08-f17a-4cf9-8071-418c81fc9665\") " pod="openshift-ingress/payload-pre-processing-7964457696-ns4kf" Jul 08 17:48:34.714846 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:48:34.714848 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2378db08-f17a-4cf9-8071-418c81fc9665-plugins-config-volume\") pod \"payload-pre-processing-7964457696-ns4kf\" (UID: \"2378db08-f17a-4cf9-8071-418c81fc9665\") " pod="openshift-ingress/payload-pre-processing-7964457696-ns4kf" Jul 08 17:48:34.715654 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:48:34.715630 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2378db08-f17a-4cf9-8071-418c81fc9665-plugins-config-volume\") pod \"payload-pre-processing-7964457696-ns4kf\" (UID: \"2378db08-f17a-4cf9-8071-418c81fc9665\") " pod="openshift-ingress/payload-pre-processing-7964457696-ns4kf" Jul 08 17:48:34.723236 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:48:34.723176 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tcp9\" (UniqueName: \"kubernetes.io/projected/2378db08-f17a-4cf9-8071-418c81fc9665-kube-api-access-5tcp9\") pod \"payload-pre-processing-7964457696-ns4kf\" (UID: \"2378db08-f17a-4cf9-8071-418c81fc9665\") " pod="openshift-ingress/payload-pre-processing-7964457696-ns4kf" Jul 08 17:48:34.894419 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:48:34.894387 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-ns4kf" Jul 08 17:48:35.051076 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:48:35.051054 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-ns4kf"] Jul 08 17:48:35.052808 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:48:35.052775 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2378db08_f17a_4cf9_8071_418c81fc9665.slice/crio-b3120e822d195f01316c1dbc3672edc00396f96877c741f53fde0f606637109e WatchSource:0}: Error finding container b3120e822d195f01316c1dbc3672edc00396f96877c741f53fde0f606637109e: Status 404 returned error can't find the container with id b3120e822d195f01316c1dbc3672edc00396f96877c741f53fde0f606637109e Jul 08 17:48:35.054579 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:48:35.054563 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 17:48:35.462416 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:48:35.462380 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-ns4kf" event={"ID":"2378db08-f17a-4cf9-8071-418c81fc9665","Type":"ContainerStarted","Data":"b3120e822d195f01316c1dbc3672edc00396f96877c741f53fde0f606637109e"} Jul 08 17:48:36.469803 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:48:36.469763 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-ns4kf" event={"ID":"2378db08-f17a-4cf9-8071-418c81fc9665","Type":"ContainerStarted","Data":"d207ec8b1a811416117927e7193ebb20478b887dc2dd9c18b18e3fed806383f8"} Jul 08 17:48:36.470203 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:48:36.469851 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-ns4kf" Jul 08 17:48:36.486047 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:48:36.485928 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-ns4kf" podStartSLOduration=1.310890065 podStartE2EDuration="2.485908464s" totalImagesPullingTime="1.175018399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:48:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:48:36.484834504 +0000 UTC m=+914.721226758" watchObservedRunningTime="2026-07-08 17:48:36.485908464 +0000 UTC m=+914.722300719" Jul 08 17:48:44.605169 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:48:44.605135 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:48:44.696112 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:48:44.696062 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:48:47.477421 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:48:47.477384 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-ns4kf" Jul 08 17:48:59.533367 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:48:59.533337 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:49:22.151030 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:22.150996 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:49:30.416269 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:30.416229 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-5q5xz"] Jul 08 17:49:30.419760 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:30.419739 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5q5xz" Jul 08 17:49:30.423796 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:30.423774 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 08 17:49:30.424061 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:30.424045 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 08 17:49:30.424123 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:30.424080 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vqlnk\"" Jul 08 17:49:30.425035 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:30.425020 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 08 17:49:30.434909 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:30.434888 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-5q5xz"] Jul 08 17:49:30.467369 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:30.467338 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:49:30.489244 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:30.489212 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98cd9a43-e0ce-40d6-aa68-248427e45089-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5q5xz\" (UID: \"98cd9a43-e0ce-40d6-aa68-248427e45089\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5q5xz" Jul 08 17:49:30.489389 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:30.489264 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98cd9a43-e0ce-40d6-aa68-248427e45089-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5q5xz\" (UID: \"98cd9a43-e0ce-40d6-aa68-248427e45089\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5q5xz" Jul 08 17:49:30.489389 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:30.489309 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98cd9a43-e0ce-40d6-aa68-248427e45089-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5q5xz\" (UID: \"98cd9a43-e0ce-40d6-aa68-248427e45089\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5q5xz" Jul 08 17:49:30.489389 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:30.489355 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx6kf\" (UniqueName: \"kubernetes.io/projected/98cd9a43-e0ce-40d6-aa68-248427e45089-kube-api-access-vx6kf\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5q5xz\" (UID: \"98cd9a43-e0ce-40d6-aa68-248427e45089\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5q5xz" Jul 08 17:49:30.489586 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:30.489427 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98cd9a43-e0ce-40d6-aa68-248427e45089-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5q5xz\" (UID: \"98cd9a43-e0ce-40d6-aa68-248427e45089\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5q5xz" Jul 08 17:49:30.489586 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:30.489456 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98cd9a43-e0ce-40d6-aa68-248427e45089-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5q5xz\" (UID: \"98cd9a43-e0ce-40d6-aa68-248427e45089\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5q5xz" Jul 08 17:49:30.590050 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:30.590007 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98cd9a43-e0ce-40d6-aa68-248427e45089-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5q5xz\" (UID: \"98cd9a43-e0ce-40d6-aa68-248427e45089\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5q5xz" Jul 08 17:49:30.590050 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:30.590061 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98cd9a43-e0ce-40d6-aa68-248427e45089-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5q5xz\" (UID: \"98cd9a43-e0ce-40d6-aa68-248427e45089\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5q5xz" Jul 08 17:49:30.590289 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:30.590117 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98cd9a43-e0ce-40d6-aa68-248427e45089-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5q5xz\" (UID: \"98cd9a43-e0ce-40d6-aa68-248427e45089\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5q5xz" Jul 08 17:49:30.590289 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:30.590148 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98cd9a43-e0ce-40d6-aa68-248427e45089-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5q5xz\" (UID: \"98cd9a43-e0ce-40d6-aa68-248427e45089\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5q5xz" Jul 08 17:49:30.590289 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:30.590172 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98cd9a43-e0ce-40d6-aa68-248427e45089-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5q5xz\" (UID: \"98cd9a43-e0ce-40d6-aa68-248427e45089\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5q5xz" Jul 08 17:49:30.590289 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:30.590189 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx6kf\" (UniqueName: \"kubernetes.io/projected/98cd9a43-e0ce-40d6-aa68-248427e45089-kube-api-access-vx6kf\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5q5xz\" (UID: \"98cd9a43-e0ce-40d6-aa68-248427e45089\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5q5xz" Jul 08 17:49:30.590506 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:30.590398 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/98cd9a43-e0ce-40d6-aa68-248427e45089-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5q5xz\" (UID: \"98cd9a43-e0ce-40d6-aa68-248427e45089\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5q5xz" Jul 08 17:49:30.590596 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:30.590505 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98cd9a43-e0ce-40d6-aa68-248427e45089-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5q5xz\" (UID: \"98cd9a43-e0ce-40d6-aa68-248427e45089\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5q5xz" Jul 08 17:49:30.590642 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:30.590633 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/98cd9a43-e0ce-40d6-aa68-248427e45089-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5q5xz\" (UID: \"98cd9a43-e0ce-40d6-aa68-248427e45089\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5q5xz" Jul 08 17:49:30.592588 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:30.592568 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/98cd9a43-e0ce-40d6-aa68-248427e45089-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5q5xz\" (UID: \"98cd9a43-e0ce-40d6-aa68-248427e45089\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5q5xz" Jul 08 17:49:30.592730 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:30.592716 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/98cd9a43-e0ce-40d6-aa68-248427e45089-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5q5xz\" (UID: \"98cd9a43-e0ce-40d6-aa68-248427e45089\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5q5xz" Jul 08 17:49:30.599362 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:30.599335 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx6kf\" (UniqueName: \"kubernetes.io/projected/98cd9a43-e0ce-40d6-aa68-248427e45089-kube-api-access-vx6kf\") pod \"e2e-distinct-simulated-kserve-59975d69f9-5q5xz\" (UID: \"98cd9a43-e0ce-40d6-aa68-248427e45089\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5q5xz" Jul 08 17:49:30.730635 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:30.730605 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5q5xz" Jul 08 17:49:30.870629 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:30.870602 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-5q5xz"] Jul 08 17:49:30.872572 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:49:30.872515 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98cd9a43_e0ce_40d6_aa68_248427e45089.slice/crio-4d77c569892fe58f92076563aac44854f57179a9509605dee5589003c8b6d1bf WatchSource:0}: Error finding container 4d77c569892fe58f92076563aac44854f57179a9509605dee5589003c8b6d1bf: Status 404 returned error can't find the container with id 4d77c569892fe58f92076563aac44854f57179a9509605dee5589003c8b6d1bf Jul 08 17:49:31.753556 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:31.753492 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5q5xz" event={"ID":"98cd9a43-e0ce-40d6-aa68-248427e45089","Type":"ContainerStarted","Data":"4d77c569892fe58f92076563aac44854f57179a9509605dee5589003c8b6d1bf"} Jul 08 17:49:32.760526 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:32.760485 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5q5xz" event={"ID":"98cd9a43-e0ce-40d6-aa68-248427e45089","Type":"ContainerStarted","Data":"a376e81fa18b7d9c5c78d0ca144e8f182d13fce346a4be1282e8e69fe1b1760b"} Jul 08 17:49:32.783295 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:32.783251 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5q5xz" podStartSLOduration=1.493806527 podStartE2EDuration="2.783235374s" totalImagesPullingTime="1.289428847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:49:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:49:32.780430022 +0000 UTC m=+971.016822274" watchObservedRunningTime="2026-07-08 17:49:32.783235374 +0000 UTC m=+971.019627671" Jul 08 17:49:40.731132 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:40.731095 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5q5xz" Jul 08 17:49:40.731615 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:40.731170 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5q5xz" Jul 08 17:49:40.743766 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:40.743739 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5q5xz" Jul 08 17:49:40.816416 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:40.816388 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-5q5xz" Jul 08 17:49:42.136708 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:42.136674 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:49:52.198527 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:52.198438 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx"] Jul 08 17:49:52.201960 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:52.201937 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx" Jul 08 17:49:52.204443 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:52.204427 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 08 17:49:52.213560 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:52.213509 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx"] Jul 08 17:49:52.286761 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:52.286725 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9200d9d-2d2b-42f1-ba45-00137f5aa113-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx\" (UID: \"e9200d9d-2d2b-42f1-ba45-00137f5aa113\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx" Jul 08 17:49:52.286949 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:52.286782 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9200d9d-2d2b-42f1-ba45-00137f5aa113-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx\" (UID: \"e9200d9d-2d2b-42f1-ba45-00137f5aa113\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx" Jul 08 17:49:52.286949 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:52.286831 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9200d9d-2d2b-42f1-ba45-00137f5aa113-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx\" (UID: \"e9200d9d-2d2b-42f1-ba45-00137f5aa113\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx" Jul 08 17:49:52.286949 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:52.286863 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqjhz\" (UniqueName: \"kubernetes.io/projected/e9200d9d-2d2b-42f1-ba45-00137f5aa113-kube-api-access-qqjhz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx\" (UID: \"e9200d9d-2d2b-42f1-ba45-00137f5aa113\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx" Jul 08 17:49:52.287109 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:52.286953 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9200d9d-2d2b-42f1-ba45-00137f5aa113-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx\" (UID: \"e9200d9d-2d2b-42f1-ba45-00137f5aa113\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx" Jul 08 17:49:52.287109 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:52.287008 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9200d9d-2d2b-42f1-ba45-00137f5aa113-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx\" (UID: \"e9200d9d-2d2b-42f1-ba45-00137f5aa113\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx" Jul 08 17:49:52.388475 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:52.388435 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9200d9d-2d2b-42f1-ba45-00137f5aa113-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx\" (UID: \"e9200d9d-2d2b-42f1-ba45-00137f5aa113\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx" Jul 08 17:49:52.388691 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:52.388493 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9200d9d-2d2b-42f1-ba45-00137f5aa113-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx\" (UID: \"e9200d9d-2d2b-42f1-ba45-00137f5aa113\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx" Jul 08 17:49:52.388691 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:52.388588 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9200d9d-2d2b-42f1-ba45-00137f5aa113-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx\" (UID: \"e9200d9d-2d2b-42f1-ba45-00137f5aa113\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx" Jul 08 17:49:52.388691 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:52.388669 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9200d9d-2d2b-42f1-ba45-00137f5aa113-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx\" (UID: \"e9200d9d-2d2b-42f1-ba45-00137f5aa113\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx" Jul 08 17:49:52.388855 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:52.388695 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9200d9d-2d2b-42f1-ba45-00137f5aa113-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx\" (UID: \"e9200d9d-2d2b-42f1-ba45-00137f5aa113\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx" Jul 08 17:49:52.388855 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:52.388718 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqjhz\" (UniqueName: \"kubernetes.io/projected/e9200d9d-2d2b-42f1-ba45-00137f5aa113-kube-api-access-qqjhz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx\" (UID: \"e9200d9d-2d2b-42f1-ba45-00137f5aa113\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx" Jul 08 17:49:52.389018 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:52.388902 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9200d9d-2d2b-42f1-ba45-00137f5aa113-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx\" (UID: \"e9200d9d-2d2b-42f1-ba45-00137f5aa113\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx" Jul 08 17:49:52.389018 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:52.388952 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9200d9d-2d2b-42f1-ba45-00137f5aa113-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx\" (UID: \"e9200d9d-2d2b-42f1-ba45-00137f5aa113\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx" Jul 08 17:49:52.389110 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:52.389054 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9200d9d-2d2b-42f1-ba45-00137f5aa113-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx\" (UID: \"e9200d9d-2d2b-42f1-ba45-00137f5aa113\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx" Jul 08 17:49:52.391141 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:52.391112 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9200d9d-2d2b-42f1-ba45-00137f5aa113-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx\" (UID: \"e9200d9d-2d2b-42f1-ba45-00137f5aa113\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx" Jul 08 17:49:52.391407 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:52.391388 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9200d9d-2d2b-42f1-ba45-00137f5aa113-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx\" (UID: \"e9200d9d-2d2b-42f1-ba45-00137f5aa113\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx" Jul 08 17:49:52.406239 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:52.406207 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:49:52.407560 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:52.407514 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqjhz\" (UniqueName: \"kubernetes.io/projected/e9200d9d-2d2b-42f1-ba45-00137f5aa113-kube-api-access-qqjhz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx\" (UID: \"e9200d9d-2d2b-42f1-ba45-00137f5aa113\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx" Jul 08 17:49:52.512606 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:52.512491 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx" Jul 08 17:49:52.656661 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:52.656636 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx"] Jul 08 17:49:52.658249 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:49:52.658224 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9200d9d_2d2b_42f1_ba45_00137f5aa113.slice/crio-f9636a9e14e8deebf6b4febbfc661cd0bdf5ac3824914ee51e90a85fc5c8a9a6 WatchSource:0}: Error finding container f9636a9e14e8deebf6b4febbfc661cd0bdf5ac3824914ee51e90a85fc5c8a9a6: Status 404 returned error can't find the container with id f9636a9e14e8deebf6b4febbfc661cd0bdf5ac3824914ee51e90a85fc5c8a9a6 Jul 08 17:49:52.867650 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:52.867570 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx" event={"ID":"e9200d9d-2d2b-42f1-ba45-00137f5aa113","Type":"ContainerStarted","Data":"f9636a9e14e8deebf6b4febbfc661cd0bdf5ac3824914ee51e90a85fc5c8a9a6"} Jul 08 17:49:53.874775 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:53.874745 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx" event={"ID":"e9200d9d-2d2b-42f1-ba45-00137f5aa113","Type":"ContainerStarted","Data":"12af08fc26d6b1313fdf8404e0349457d14df2742ef4ee51a476ea2936581ea5"} Jul 08 17:49:53.894634 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:49:53.894586 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx" podStartSLOduration=1.6728075009999999 podStartE2EDuration="1.894570972s" totalImagesPullingTime="221.763471ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:49:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:49:53.892876869 +0000 UTC m=+992.129269123" watchObservedRunningTime="2026-07-08 17:49:53.894570972 +0000 UTC m=+992.130963224" Jul 08 17:50:02.108595 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:50:02.108560 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:50:02.513524 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:50:02.513495 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx" Jul 08 17:50:02.513742 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:50:02.513565 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx" Jul 08 17:50:02.526175 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:50:02.526151 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx" Jul 08 17:50:02.938962 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:50:02.938889 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx" Jul 08 17:50:05.784845 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:50:05.784811 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:50:12.436664 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:50:12.436631 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:50:18.339981 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:50:18.339951 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:50:30.660356 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:50:30.660314 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:50:30.762005 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:50:30.761948 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:51:15.685003 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:51:15.684922 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-bc745d9c6-nlc68"] Jul 08 17:51:15.688515 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:51:15.688495 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-bc745d9c6-nlc68" Jul 08 17:51:15.698911 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:51:15.698889 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-bc745d9c6-nlc68"] Jul 08 17:51:15.815768 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:51:15.815730 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdcgp\" (UniqueName: \"kubernetes.io/projected/d18b6dd5-5528-44b3-b43f-332d6f5d753a-kube-api-access-tdcgp\") pod \"authorino-bc745d9c6-nlc68\" (UID: \"d18b6dd5-5528-44b3-b43f-332d6f5d753a\") " pod="kuadrant-system/authorino-bc745d9c6-nlc68" Jul 08 17:51:15.815953 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:51:15.815814 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d18b6dd5-5528-44b3-b43f-332d6f5d753a-tls-cert\") pod \"authorino-bc745d9c6-nlc68\" (UID: \"d18b6dd5-5528-44b3-b43f-332d6f5d753a\") " pod="kuadrant-system/authorino-bc745d9c6-nlc68" Jul 08 17:51:15.917063 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:51:15.917022 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdcgp\" (UniqueName: \"kubernetes.io/projected/d18b6dd5-5528-44b3-b43f-332d6f5d753a-kube-api-access-tdcgp\") pod \"authorino-bc745d9c6-nlc68\" (UID: \"d18b6dd5-5528-44b3-b43f-332d6f5d753a\") " pod="kuadrant-system/authorino-bc745d9c6-nlc68" Jul 08 17:51:15.917221 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:51:15.917089 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d18b6dd5-5528-44b3-b43f-332d6f5d753a-tls-cert\") pod \"authorino-bc745d9c6-nlc68\" (UID: \"d18b6dd5-5528-44b3-b43f-332d6f5d753a\") " pod="kuadrant-system/authorino-bc745d9c6-nlc68" Jul 08 17:51:15.919614 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:51:15.919586 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d18b6dd5-5528-44b3-b43f-332d6f5d753a-tls-cert\") pod \"authorino-bc745d9c6-nlc68\" (UID: \"d18b6dd5-5528-44b3-b43f-332d6f5d753a\") " pod="kuadrant-system/authorino-bc745d9c6-nlc68" Jul 08 17:51:15.925633 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:51:15.925607 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdcgp\" (UniqueName: \"kubernetes.io/projected/d18b6dd5-5528-44b3-b43f-332d6f5d753a-kube-api-access-tdcgp\") pod \"authorino-bc745d9c6-nlc68\" (UID: \"d18b6dd5-5528-44b3-b43f-332d6f5d753a\") " pod="kuadrant-system/authorino-bc745d9c6-nlc68" Jul 08 17:51:15.997611 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:51:15.997579 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-bc745d9c6-nlc68" Jul 08 17:51:16.120646 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:51:16.120491 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:51:16.143258 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:51:16.143222 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-bc745d9c6-nlc68"] Jul 08 17:51:16.144299 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:51:16.144265 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd18b6dd5_5528_44b3_b43f_332d6f5d753a.slice/crio-939ef51859c339f1bc83726cbdf810731629b2b7b24c946ab0f626cfab6f2c24 WatchSource:0}: Error finding container 939ef51859c339f1bc83726cbdf810731629b2b7b24c946ab0f626cfab6f2c24: Status 404 returned error can't find the container with id 939ef51859c339f1bc83726cbdf810731629b2b7b24c946ab0f626cfab6f2c24 Jul 08 17:51:16.310637 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:51:16.310527 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-bc745d9c6-nlc68" event={"ID":"d18b6dd5-5528-44b3-b43f-332d6f5d753a","Type":"ContainerStarted","Data":"939ef51859c339f1bc83726cbdf810731629b2b7b24c946ab0f626cfab6f2c24"} Jul 08 17:51:17.320112 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:51:17.320070 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-bc745d9c6-nlc68" event={"ID":"d18b6dd5-5528-44b3-b43f-332d6f5d753a","Type":"ContainerStarted","Data":"48bb3344d3ba74b12f62c8b3ef3498d510c989a9effd7e9e4bd2e99f865e0178"} Jul 08 17:51:17.351647 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:51:17.351590 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-bc745d9c6-nlc68" podStartSLOduration=1.759294581 podStartE2EDuration="2.351566422s" totalImagesPullingTime="592.271841ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:51:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:51:17.348725078 +0000 UTC m=+1075.585117332" watchObservedRunningTime="2026-07-08 17:51:17.351566422 +0000 UTC m=+1075.587958677" Jul 08 17:51:17.403522 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:51:17.403487 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557ff8454f-7z2fz"] Jul 08 17:51:17.403785 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:51:17.403759 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-557ff8454f-7z2fz" podUID="77435991-4cbe-45ca-88cc-1a629c1d57ad" containerName="authorino" containerID="cri-o://d20bbfc978d3182313923512b88aae974b8d0eb78966dee11a374d6b6ed4ae36" gracePeriod=30 Jul 08 17:51:17.677345 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:51:17.677321 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557ff8454f-7z2fz" Jul 08 17:51:17.737759 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:51:17.737721 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxrrv\" (UniqueName: \"kubernetes.io/projected/77435991-4cbe-45ca-88cc-1a629c1d57ad-kube-api-access-zxrrv\") pod \"77435991-4cbe-45ca-88cc-1a629c1d57ad\" (UID: \"77435991-4cbe-45ca-88cc-1a629c1d57ad\") " Jul 08 17:51:17.737931 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:51:17.737779 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/77435991-4cbe-45ca-88cc-1a629c1d57ad-tls-cert\") pod \"77435991-4cbe-45ca-88cc-1a629c1d57ad\" (UID: \"77435991-4cbe-45ca-88cc-1a629c1d57ad\") " Jul 08 17:51:17.739992 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:51:17.739967 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77435991-4cbe-45ca-88cc-1a629c1d57ad-kube-api-access-zxrrv" (OuterVolumeSpecName: "kube-api-access-zxrrv") pod "77435991-4cbe-45ca-88cc-1a629c1d57ad" (UID: "77435991-4cbe-45ca-88cc-1a629c1d57ad"). InnerVolumeSpecName "kube-api-access-zxrrv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:51:17.750982 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:51:17.750950 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77435991-4cbe-45ca-88cc-1a629c1d57ad-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "77435991-4cbe-45ca-88cc-1a629c1d57ad" (UID: "77435991-4cbe-45ca-88cc-1a629c1d57ad"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 17:51:17.838574 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:51:17.838467 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxrrv\" (UniqueName: \"kubernetes.io/projected/77435991-4cbe-45ca-88cc-1a629c1d57ad-kube-api-access-zxrrv\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 17:51:17.838574 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:51:17.838496 2552 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/77435991-4cbe-45ca-88cc-1a629c1d57ad-tls-cert\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 17:51:18.326880 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:51:18.326835 2552 generic.go:356] "Generic (PLEG): container finished" podID="77435991-4cbe-45ca-88cc-1a629c1d57ad" containerID="d20bbfc978d3182313923512b88aae974b8d0eb78966dee11a374d6b6ed4ae36" exitCode=0 Jul 08 17:51:18.327305 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:51:18.326891 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557ff8454f-7z2fz" Jul 08 17:51:18.327305 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:51:18.326951 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557ff8454f-7z2fz" event={"ID":"77435991-4cbe-45ca-88cc-1a629c1d57ad","Type":"ContainerDied","Data":"d20bbfc978d3182313923512b88aae974b8d0eb78966dee11a374d6b6ed4ae36"} Jul 08 17:51:18.327305 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:51:18.326988 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557ff8454f-7z2fz" event={"ID":"77435991-4cbe-45ca-88cc-1a629c1d57ad","Type":"ContainerDied","Data":"d18068617e638da98edc5247fe218580562ed024ad637bc1c6ad6890c58c939d"} Jul 08 17:51:18.327305 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:51:18.327008 2552 scope.go:117] "RemoveContainer" containerID="d20bbfc978d3182313923512b88aae974b8d0eb78966dee11a374d6b6ed4ae36" Jul 08 17:51:18.336840 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:51:18.336822 2552 scope.go:117] "RemoveContainer" containerID="d20bbfc978d3182313923512b88aae974b8d0eb78966dee11a374d6b6ed4ae36" Jul 08 17:51:18.337098 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:51:18.337080 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d20bbfc978d3182313923512b88aae974b8d0eb78966dee11a374d6b6ed4ae36\": container with ID starting with d20bbfc978d3182313923512b88aae974b8d0eb78966dee11a374d6b6ed4ae36 not found: ID does not exist" containerID="d20bbfc978d3182313923512b88aae974b8d0eb78966dee11a374d6b6ed4ae36" Jul 08 17:51:18.337161 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:51:18.337107 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d20bbfc978d3182313923512b88aae974b8d0eb78966dee11a374d6b6ed4ae36"} err="failed to get container status \"d20bbfc978d3182313923512b88aae974b8d0eb78966dee11a374d6b6ed4ae36\": rpc error: code = NotFound desc = could not find container \"d20bbfc978d3182313923512b88aae974b8d0eb78966dee11a374d6b6ed4ae36\": container with ID starting with d20bbfc978d3182313923512b88aae974b8d0eb78966dee11a374d6b6ed4ae36 not found: ID does not exist" Jul 08 17:51:18.345214 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:51:18.345187 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557ff8454f-7z2fz"] Jul 08 17:51:18.354211 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:51:18.354178 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557ff8454f-7z2fz"] Jul 08 17:51:18.437978 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:51:18.437941 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:51:20.307800 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:51:20.307765 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77435991-4cbe-45ca-88cc-1a629c1d57ad" path="/var/lib/kubelet/pods/77435991-4cbe-45ca-88cc-1a629c1d57ad/volumes" Jul 08 17:52:25.625114 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:52:25.625072 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:52:28.065236 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:52:28.065200 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:52:29.814348 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:52:29.814308 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:52:43.707785 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:52:43.707696 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:53:08.428937 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:53:08.428872 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:53:08.519583 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:53:08.519526 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:53:08.624549 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:53:08.624508 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:53:14.793918 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:53:14.793885 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:53:14.902133 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:53:14.902083 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:53:14.993673 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:53:14.993635 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:53:15.115777 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:53:15.115690 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:53:21.432495 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:53:21.432457 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:53:21.532982 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:53:21.532946 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:53:22.286364 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:53:22.286333 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-mnhqg_058a4314-4829-4b3d-a275-477b305bcf91/console-operator/1.log" Jul 08 17:53:22.286564 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:53:22.286333 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-mnhqg_058a4314-4829-4b3d-a275-477b305bcf91/console-operator/1.log" Jul 08 17:53:24.020736 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:53:24.020700 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:53:42.315149 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:53:42.315117 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:53:42.375999 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:53:42.375959 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:55:57.827000 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:55:57.826969 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:55:57.915233 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:55:57.915200 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:56:26.187390 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:56:26.187350 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:56:31.674207 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:56:31.674175 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:56:48.907818 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:56:48.907763 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:56:49.009824 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:56:49.009790 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:57:08.470809 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:57:08.470775 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:57:14.101293 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:57:14.101206 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rw4g2"] Jul 08 17:57:14.101696 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:57:14.101496 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rw4g2" podUID="2337f2a7-cdd3-493f-9cff-a56e229fccaf" containerName="manager" containerID="cri-o://687e3dfaddb27a1952f4798c93969e025623cd7d110a80c6b709a0e542a5c190" gracePeriod=10 Jul 08 17:57:16.955058 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:57:16.955029 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rw4g2" Jul 08 17:57:17.135949 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:57:17.135837 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2337f2a7-cdd3-493f-9cff-a56e229fccaf-extensions-socket-volume\") pod \"2337f2a7-cdd3-493f-9cff-a56e229fccaf\" (UID: \"2337f2a7-cdd3-493f-9cff-a56e229fccaf\") " Jul 08 17:57:17.135949 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:57:17.135915 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fj6fz\" (UniqueName: \"kubernetes.io/projected/2337f2a7-cdd3-493f-9cff-a56e229fccaf-kube-api-access-fj6fz\") pod \"2337f2a7-cdd3-493f-9cff-a56e229fccaf\" (UID: \"2337f2a7-cdd3-493f-9cff-a56e229fccaf\") " Jul 08 17:57:17.136275 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:57:17.136247 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2337f2a7-cdd3-493f-9cff-a56e229fccaf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2337f2a7-cdd3-493f-9cff-a56e229fccaf" (UID: "2337f2a7-cdd3-493f-9cff-a56e229fccaf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 17:57:17.138115 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:57:17.138095 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2337f2a7-cdd3-493f-9cff-a56e229fccaf-kube-api-access-fj6fz" (OuterVolumeSpecName: "kube-api-access-fj6fz") pod "2337f2a7-cdd3-493f-9cff-a56e229fccaf" (UID: "2337f2a7-cdd3-493f-9cff-a56e229fccaf"). InnerVolumeSpecName "kube-api-access-fj6fz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 17:57:17.236769 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:57:17.236733 2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2337f2a7-cdd3-493f-9cff-a56e229fccaf-extensions-socket-volume\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 17:57:17.236769 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:57:17.236761 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fj6fz\" (UniqueName: \"kubernetes.io/projected/2337f2a7-cdd3-493f-9cff-a56e229fccaf-kube-api-access-fj6fz\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 17:57:17.269126 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:57:17.269085 2552 generic.go:356] "Generic (PLEG): container finished" podID="2337f2a7-cdd3-493f-9cff-a56e229fccaf" containerID="687e3dfaddb27a1952f4798c93969e025623cd7d110a80c6b709a0e542a5c190" exitCode=0 Jul 08 17:57:17.269300 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:57:17.269129 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rw4g2" Jul 08 17:57:17.269300 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:57:17.269168 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rw4g2" event={"ID":"2337f2a7-cdd3-493f-9cff-a56e229fccaf","Type":"ContainerDied","Data":"687e3dfaddb27a1952f4798c93969e025623cd7d110a80c6b709a0e542a5c190"} Jul 08 17:57:17.269300 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:57:17.269260 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rw4g2" event={"ID":"2337f2a7-cdd3-493f-9cff-a56e229fccaf","Type":"ContainerDied","Data":"9da313425e955ce9ed0b05f4a1888bc1fe2eb48420708cd9163f0e427810e9de"} Jul 08 17:57:17.269300 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:57:17.269293 2552 scope.go:117] "RemoveContainer" containerID="687e3dfaddb27a1952f4798c93969e025623cd7d110a80c6b709a0e542a5c190" Jul 08 17:57:17.279658 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:57:17.279641 2552 scope.go:117] "RemoveContainer" containerID="687e3dfaddb27a1952f4798c93969e025623cd7d110a80c6b709a0e542a5c190" Jul 08 17:57:17.279955 ip-10-0-130-38 kubenswrapper[2552]: E0708 17:57:17.279935 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"687e3dfaddb27a1952f4798c93969e025623cd7d110a80c6b709a0e542a5c190\": container with ID starting with 687e3dfaddb27a1952f4798c93969e025623cd7d110a80c6b709a0e542a5c190 not found: ID does not exist" containerID="687e3dfaddb27a1952f4798c93969e025623cd7d110a80c6b709a0e542a5c190" Jul 08 17:57:17.279995 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:57:17.279966 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"687e3dfaddb27a1952f4798c93969e025623cd7d110a80c6b709a0e542a5c190"} err="failed to get container status \"687e3dfaddb27a1952f4798c93969e025623cd7d110a80c6b709a0e542a5c190\": rpc error: code = NotFound desc = could not find container \"687e3dfaddb27a1952f4798c93969e025623cd7d110a80c6b709a0e542a5c190\": container with ID starting with 687e3dfaddb27a1952f4798c93969e025623cd7d110a80c6b709a0e542a5c190 not found: ID does not exist" Jul 08 17:57:17.299112 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:57:17.299086 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rw4g2"] Jul 08 17:57:17.306352 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:57:17.306329 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-rw4g2"] Jul 08 17:57:18.306298 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:57:18.306256 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2337f2a7-cdd3-493f-9cff-a56e229fccaf" path="/var/lib/kubelet/pods/2337f2a7-cdd3-493f-9cff-a56e229fccaf/volumes" Jul 08 17:58:15.246985 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:58:15.246948 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vgm8b"] Jul 08 17:58:15.247495 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:58:15.247323 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77435991-4cbe-45ca-88cc-1a629c1d57ad" containerName="authorino" Jul 08 17:58:15.247495 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:58:15.247334 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="77435991-4cbe-45ca-88cc-1a629c1d57ad" containerName="authorino" Jul 08 17:58:15.247495 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:58:15.247345 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2337f2a7-cdd3-493f-9cff-a56e229fccaf" containerName="manager" Jul 08 17:58:15.247495 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:58:15.247350 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="2337f2a7-cdd3-493f-9cff-a56e229fccaf" containerName="manager" Jul 08 17:58:15.247495 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:58:15.247406 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="2337f2a7-cdd3-493f-9cff-a56e229fccaf" containerName="manager" Jul 08 17:58:15.247495 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:58:15.247416 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="77435991-4cbe-45ca-88cc-1a629c1d57ad" containerName="authorino" Jul 08 17:58:15.250635 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:58:15.250618 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vgm8b" Jul 08 17:58:15.253233 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:58:15.253208 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-bb4fd\"" Jul 08 17:58:15.264639 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:58:15.264612 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vgm8b"] Jul 08 17:58:15.332680 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:58:15.332645 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bccd334a-41a0-4757-8bef-0580f71a02cc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vgm8b\" (UID: \"bccd334a-41a0-4757-8bef-0580f71a02cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vgm8b" Jul 08 17:58:15.332867 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:58:15.332771 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z7xk\" (UniqueName: \"kubernetes.io/projected/bccd334a-41a0-4757-8bef-0580f71a02cc-kube-api-access-5z7xk\") pod \"kuadrant-operator-controller-manager-86878c769f-vgm8b\" (UID: \"bccd334a-41a0-4757-8bef-0580f71a02cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vgm8b" Jul 08 17:58:15.434022 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:58:15.433986 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z7xk\" (UniqueName: \"kubernetes.io/projected/bccd334a-41a0-4757-8bef-0580f71a02cc-kube-api-access-5z7xk\") pod \"kuadrant-operator-controller-manager-86878c769f-vgm8b\" (UID: \"bccd334a-41a0-4757-8bef-0580f71a02cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vgm8b" Jul 08 17:58:15.434188 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:58:15.434090 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bccd334a-41a0-4757-8bef-0580f71a02cc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vgm8b\" (UID: \"bccd334a-41a0-4757-8bef-0580f71a02cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vgm8b" Jul 08 17:58:15.434481 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:58:15.434463 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bccd334a-41a0-4757-8bef-0580f71a02cc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vgm8b\" (UID: \"bccd334a-41a0-4757-8bef-0580f71a02cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vgm8b" Jul 08 17:58:15.444669 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:58:15.444644 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z7xk\" (UniqueName: \"kubernetes.io/projected/bccd334a-41a0-4757-8bef-0580f71a02cc-kube-api-access-5z7xk\") pod \"kuadrant-operator-controller-manager-86878c769f-vgm8b\" (UID: \"bccd334a-41a0-4757-8bef-0580f71a02cc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vgm8b" Jul 08 17:58:15.561244 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:58:15.561152 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vgm8b" Jul 08 17:58:15.717827 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:58:15.717795 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vgm8b"] Jul 08 17:58:15.718558 ip-10-0-130-38 kubenswrapper[2552]: W0708 17:58:15.718516 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbccd334a_41a0_4757_8bef_0580f71a02cc.slice/crio-451ca8c57d7e1c69cee581abcff5a6c004ea8c6b32eec308a4d308284ef08dc3 WatchSource:0}: Error finding container 451ca8c57d7e1c69cee581abcff5a6c004ea8c6b32eec308a4d308284ef08dc3: Status 404 returned error can't find the container with id 451ca8c57d7e1c69cee581abcff5a6c004ea8c6b32eec308a4d308284ef08dc3 Jul 08 17:58:16.587623 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:58:16.587583 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vgm8b" event={"ID":"bccd334a-41a0-4757-8bef-0580f71a02cc","Type":"ContainerStarted","Data":"3ed38dae1916bcc598514d71d3a0c41aa1816240dd17295a579578bd8b859a75"} Jul 08 17:58:16.588024 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:58:16.587636 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vgm8b" event={"ID":"bccd334a-41a0-4757-8bef-0580f71a02cc","Type":"ContainerStarted","Data":"451ca8c57d7e1c69cee581abcff5a6c004ea8c6b32eec308a4d308284ef08dc3"} Jul 08 17:58:16.588024 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:58:16.587655 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vgm8b" Jul 08 17:58:16.613155 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:58:16.613110 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vgm8b" podStartSLOduration=1.6130955070000002 podStartE2EDuration="1.613095507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 17:58:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 17:58:16.609394542 +0000 UTC m=+1494.845786795" watchObservedRunningTime="2026-07-08 17:58:16.613095507 +0000 UTC m=+1494.849487760" Jul 08 17:58:22.320955 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:58:22.320928 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-mnhqg_058a4314-4829-4b3d-a275-477b305bcf91/console-operator/1.log" Jul 08 17:58:22.322065 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:58:22.322046 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-mnhqg_058a4314-4829-4b3d-a275-477b305bcf91/console-operator/1.log" Jul 08 17:58:27.595245 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:58:27.595214 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vgm8b" Jul 08 17:59:19.552039 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:59:19.552006 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 17:59:29.929574 ip-10-0-130-38 kubenswrapper[2552]: I0708 17:59:29.929522 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:03:22.355114 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:03:22.355040 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-mnhqg_058a4314-4829-4b3d-a275-477b305bcf91/console-operator/1.log" Jul 08 18:03:22.355657 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:03:22.355637 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-mnhqg_058a4314-4829-4b3d-a275-477b305bcf91/console-operator/1.log" Jul 08 18:04:06.871047 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:06.871005 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:14.330129 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:14.330093 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:22.608284 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:22.608248 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:27.839785 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:27.839756 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:30.922393 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:30.922348 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:31.022345 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:31.022307 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:31.350076 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:31.350041 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:37.882802 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:37.882730 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5"] Jul 08 18:04:37.886229 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:37.886202 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" Jul 08 18:04:37.888522 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:37.888503 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-32643458-openshift-default-dockercfg-9p82x\"" Jul 08 18:04:37.913577 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:37.913527 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5"] Jul 08 18:04:38.066413 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.066377 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/020a31c0-e1f0-441e-a375-54a0a168d797-istiod-ca-cert\") pod \"e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" Jul 08 18:04:38.066413 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.066421 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/020a31c0-e1f0-441e-a375-54a0a168d797-istio-data\") pod \"e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" Jul 08 18:04:38.066675 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.066449 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/020a31c0-e1f0-441e-a375-54a0a168d797-istio-podinfo\") pod \"e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" Jul 08 18:04:38.066675 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.066512 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/020a31c0-e1f0-441e-a375-54a0a168d797-workload-socket\") pod \"e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" Jul 08 18:04:38.066675 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.066551 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/020a31c0-e1f0-441e-a375-54a0a168d797-istio-token\") pod \"e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" Jul 08 18:04:38.066675 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.066572 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh5zb\" (UniqueName: \"kubernetes.io/projected/020a31c0-e1f0-441e-a375-54a0a168d797-kube-api-access-hh5zb\") pod \"e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" Jul 08 18:04:38.066675 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.066590 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/020a31c0-e1f0-441e-a375-54a0a168d797-credential-socket\") pod \"e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" Jul 08 18:04:38.066675 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.066616 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/020a31c0-e1f0-441e-a375-54a0a168d797-workload-certs\") pod \"e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" Jul 08 18:04:38.066897 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.066677 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/020a31c0-e1f0-441e-a375-54a0a168d797-istio-envoy\") pod \"e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" Jul 08 18:04:38.154026 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.153942 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:38.167464 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.167431 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/020a31c0-e1f0-441e-a375-54a0a168d797-istio-data\") pod \"e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" Jul 08 18:04:38.167646 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.167477 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/020a31c0-e1f0-441e-a375-54a0a168d797-istio-podinfo\") pod \"e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" Jul 08 18:04:38.167646 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.167511 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/020a31c0-e1f0-441e-a375-54a0a168d797-workload-socket\") pod \"e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" Jul 08 18:04:38.167646 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.167528 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/020a31c0-e1f0-441e-a375-54a0a168d797-istio-token\") pod \"e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" Jul 08 18:04:38.167646 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.167565 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh5zb\" (UniqueName: \"kubernetes.io/projected/020a31c0-e1f0-441e-a375-54a0a168d797-kube-api-access-hh5zb\") pod \"e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" Jul 08 18:04:38.167646 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.167596 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/020a31c0-e1f0-441e-a375-54a0a168d797-credential-socket\") pod \"e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" Jul 08 18:04:38.167646 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.167624 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/020a31c0-e1f0-441e-a375-54a0a168d797-workload-certs\") pod \"e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" Jul 08 18:04:38.168068 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.167692 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/020a31c0-e1f0-441e-a375-54a0a168d797-istio-envoy\") pod \"e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" Jul 08 18:04:38.168068 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.167760 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/020a31c0-e1f0-441e-a375-54a0a168d797-istiod-ca-cert\") pod \"e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" Jul 08 18:04:38.168068 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.167924 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/020a31c0-e1f0-441e-a375-54a0a168d797-istio-data\") pod \"e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" Jul 08 18:04:38.168068 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.168035 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/020a31c0-e1f0-441e-a375-54a0a168d797-workload-socket\") pod \"e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" Jul 08 18:04:38.168238 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.168126 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/020a31c0-e1f0-441e-a375-54a0a168d797-workload-certs\") pod \"e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" Jul 08 18:04:38.168284 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.168236 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/020a31c0-e1f0-441e-a375-54a0a168d797-credential-socket\") pod \"e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" Jul 08 18:04:38.168763 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.168740 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/020a31c0-e1f0-441e-a375-54a0a168d797-istiod-ca-cert\") pod \"e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" Jul 08 18:04:38.170146 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.170114 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/020a31c0-e1f0-441e-a375-54a0a168d797-istio-envoy\") pod \"e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" Jul 08 18:04:38.170305 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.170287 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/020a31c0-e1f0-441e-a375-54a0a168d797-istio-podinfo\") pod \"e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" Jul 08 18:04:38.175966 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.175932 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/020a31c0-e1f0-441e-a375-54a0a168d797-istio-token\") pod \"e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" Jul 08 18:04:38.176268 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.176249 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh5zb\" (UniqueName: \"kubernetes.io/projected/020a31c0-e1f0-441e-a375-54a0a168d797-kube-api-access-hh5zb\") pod \"e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" Jul 08 18:04:38.199985 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.199946 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" Jul 08 18:04:38.259186 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.259152 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:38.349987 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.349959 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5"] Jul 08 18:04:38.351944 ip-10-0-130-38 kubenswrapper[2552]: W0708 18:04:38.351912 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod020a31c0_e1f0_441e_a375_54a0a168d797.slice/crio-a9ef4f837d16784e328bfdc91b5a0df24b8fa4f0dcf39b5683d6034b514c17a6 WatchSource:0}: Error finding container a9ef4f837d16784e328bfdc91b5a0df24b8fa4f0dcf39b5683d6034b514c17a6: Status 404 returned error can't find the container with id a9ef4f837d16784e328bfdc91b5a0df24b8fa4f0dcf39b5683d6034b514c17a6 Jul 08 18:04:38.354189 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.354122 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:04:38.354298 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.354245 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:04:38.354348 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.354293 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:04:38.676746 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.676656 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" event={"ID":"020a31c0-e1f0-441e-a375-54a0a168d797","Type":"ContainerStarted","Data":"b493a917d9afcc2860ad4fa443c7f37b1d0ee6e11e9786b431b30a0dd3da9c2b"} Jul 08 18:04:38.676746 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.676708 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" event={"ID":"020a31c0-e1f0-441e-a375-54a0a168d797","Type":"ContainerStarted","Data":"a9ef4f837d16784e328bfdc91b5a0df24b8fa4f0dcf39b5683d6034b514c17a6"} Jul 08 18:04:38.699037 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:38.698987 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" podStartSLOduration=1.698970895 podStartE2EDuration="1.698970895s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:04:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:04:38.696621587 +0000 UTC m=+1876.933013839" watchObservedRunningTime="2026-07-08 18:04:38.698970895 +0000 UTC m=+1876.935363201" Jul 08 18:04:39.084712 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:39.084682 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:39.163894 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:39.163854 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:39.200935 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:39.200908 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" Jul 08 18:04:39.205739 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:39.205719 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" Jul 08 18:04:39.257421 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:39.257378 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:39.393809 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:39.393722 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:39.685068 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:39.684949 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" Jul 08 18:04:39.686244 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:39.686221 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" Jul 08 18:04:40.144357 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:40.144320 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:40.245837 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:40.245796 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:42.188093 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:42.188056 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:44.286766 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:44.286682 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:44.423136 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:44.423093 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5"] Jul 08 18:04:44.423346 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:44.423324 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" podUID="020a31c0-e1f0-441e-a375-54a0a168d797" containerName="istio-proxy" containerID="cri-o://b493a917d9afcc2860ad4fa443c7f37b1d0ee6e11e9786b431b30a0dd3da9c2b" gracePeriod=30 Jul 08 18:04:44.446594 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:44.446556 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:44.563089 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:44.562967 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:44.644266 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:44.644221 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:48.715338 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:48.715294 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:49.745688 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:49.745659 2552 generic.go:356] "Generic (PLEG): container finished" podID="020a31c0-e1f0-441e-a375-54a0a168d797" containerID="b493a917d9afcc2860ad4fa443c7f37b1d0ee6e11e9786b431b30a0dd3da9c2b" exitCode=0 Jul 08 18:04:49.746050 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:49.745730 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" event={"ID":"020a31c0-e1f0-441e-a375-54a0a168d797","Type":"ContainerDied","Data":"b493a917d9afcc2860ad4fa443c7f37b1d0ee6e11e9786b431b30a0dd3da9c2b"} Jul 08 18:04:49.881969 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:49.881942 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" Jul 08 18:04:49.993965 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:49.993930 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/020a31c0-e1f0-441e-a375-54a0a168d797-istio-podinfo\") pod \"020a31c0-e1f0-441e-a375-54a0a168d797\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " Jul 08 18:04:49.994161 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:49.993969 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/020a31c0-e1f0-441e-a375-54a0a168d797-workload-socket\") pod \"020a31c0-e1f0-441e-a375-54a0a168d797\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " Jul 08 18:04:49.994161 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:49.994005 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/020a31c0-e1f0-441e-a375-54a0a168d797-workload-certs\") pod \"020a31c0-e1f0-441e-a375-54a0a168d797\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " Jul 08 18:04:49.994161 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:49.994021 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/020a31c0-e1f0-441e-a375-54a0a168d797-istio-envoy\") pod \"020a31c0-e1f0-441e-a375-54a0a168d797\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " Jul 08 18:04:49.994161 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:49.994142 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/020a31c0-e1f0-441e-a375-54a0a168d797-istio-token\") pod \"020a31c0-e1f0-441e-a375-54a0a168d797\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " Jul 08 18:04:49.994378 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:49.994185 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/020a31c0-e1f0-441e-a375-54a0a168d797-istiod-ca-cert\") pod \"020a31c0-e1f0-441e-a375-54a0a168d797\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " Jul 08 18:04:49.994378 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:49.994258 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/020a31c0-e1f0-441e-a375-54a0a168d797-istio-data\") pod \"020a31c0-e1f0-441e-a375-54a0a168d797\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " Jul 08 18:04:49.994378 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:49.994288 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hh5zb\" (UniqueName: \"kubernetes.io/projected/020a31c0-e1f0-441e-a375-54a0a168d797-kube-api-access-hh5zb\") pod \"020a31c0-e1f0-441e-a375-54a0a168d797\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " Jul 08 18:04:49.994378 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:49.994308 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/020a31c0-e1f0-441e-a375-54a0a168d797-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "020a31c0-e1f0-441e-a375-54a0a168d797" (UID: "020a31c0-e1f0-441e-a375-54a0a168d797"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:04:49.994378 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:49.994337 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/020a31c0-e1f0-441e-a375-54a0a168d797-credential-socket\") pod \"020a31c0-e1f0-441e-a375-54a0a168d797\" (UID: \"020a31c0-e1f0-441e-a375-54a0a168d797\") " Jul 08 18:04:49.994378 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:49.994315 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/020a31c0-e1f0-441e-a375-54a0a168d797-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "020a31c0-e1f0-441e-a375-54a0a168d797" (UID: "020a31c0-e1f0-441e-a375-54a0a168d797"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:04:49.994720 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:49.994690 2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/020a31c0-e1f0-441e-a375-54a0a168d797-workload-socket\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:04:49.994720 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:49.994712 2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/020a31c0-e1f0-441e-a375-54a0a168d797-workload-certs\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:04:49.994827 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:49.994664 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/020a31c0-e1f0-441e-a375-54a0a168d797-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "020a31c0-e1f0-441e-a375-54a0a168d797" (UID: "020a31c0-e1f0-441e-a375-54a0a168d797"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:04:49.994827 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:49.994763 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/020a31c0-e1f0-441e-a375-54a0a168d797-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "020a31c0-e1f0-441e-a375-54a0a168d797" (UID: "020a31c0-e1f0-441e-a375-54a0a168d797"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:04:49.995624 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:49.995597 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/020a31c0-e1f0-441e-a375-54a0a168d797-istio-data" (OuterVolumeSpecName: "istio-data") pod "020a31c0-e1f0-441e-a375-54a0a168d797" (UID: "020a31c0-e1f0-441e-a375-54a0a168d797"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:04:49.996618 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:49.996595 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/020a31c0-e1f0-441e-a375-54a0a168d797-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "020a31c0-e1f0-441e-a375-54a0a168d797" (UID: "020a31c0-e1f0-441e-a375-54a0a168d797"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 18:04:49.996731 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:49.996627 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/020a31c0-e1f0-441e-a375-54a0a168d797-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "020a31c0-e1f0-441e-a375-54a0a168d797" (UID: "020a31c0-e1f0-441e-a375-54a0a168d797"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:04:49.996731 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:49.996710 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/020a31c0-e1f0-441e-a375-54a0a168d797-kube-api-access-hh5zb" (OuterVolumeSpecName: "kube-api-access-hh5zb") pod "020a31c0-e1f0-441e-a375-54a0a168d797" (UID: "020a31c0-e1f0-441e-a375-54a0a168d797"). InnerVolumeSpecName "kube-api-access-hh5zb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:04:49.996807 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:49.996738 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/020a31c0-e1f0-441e-a375-54a0a168d797-istio-token" (OuterVolumeSpecName: "istio-token") pod "020a31c0-e1f0-441e-a375-54a0a168d797" (UID: "020a31c0-e1f0-441e-a375-54a0a168d797"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:04:50.095175 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:50.095143 2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/020a31c0-e1f0-441e-a375-54a0a168d797-istio-podinfo\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:04:50.095175 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:50.095168 2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/020a31c0-e1f0-441e-a375-54a0a168d797-istio-envoy\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:04:50.095175 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:50.095178 2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/020a31c0-e1f0-441e-a375-54a0a168d797-istio-token\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:04:50.095390 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:50.095185 2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/020a31c0-e1f0-441e-a375-54a0a168d797-istiod-ca-cert\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:04:50.095390 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:50.095193 2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/020a31c0-e1f0-441e-a375-54a0a168d797-istio-data\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:04:50.095390 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:50.095201 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hh5zb\" (UniqueName: \"kubernetes.io/projected/020a31c0-e1f0-441e-a375-54a0a168d797-kube-api-access-hh5zb\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:04:50.095390 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:50.095214 2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/020a31c0-e1f0-441e-a375-54a0a168d797-credential-socket\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:04:50.752396 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:50.752367 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" Jul 08 18:04:50.752851 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:50.752360 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5" event={"ID":"020a31c0-e1f0-441e-a375-54a0a168d797","Type":"ContainerDied","Data":"a9ef4f837d16784e328bfdc91b5a0df24b8fa4f0dcf39b5683d6034b514c17a6"} Jul 08 18:04:50.752851 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:50.752503 2552 scope.go:117] "RemoveContainer" containerID="b493a917d9afcc2860ad4fa443c7f37b1d0ee6e11e9786b431b30a0dd3da9c2b" Jul 08 18:04:50.765410 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:50.765383 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:50.771507 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:50.771486 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5"] Jul 08 18:04:50.778913 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:50.778893 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-32643458-openshift-default-7c7c7d7df7-mfjx5"] Jul 08 18:04:50.845213 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:50.845172 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:51.074438 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.074339 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:51.164506 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.164474 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:51.213060 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.213027 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg"] Jul 08 18:04:51.213583 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.213510 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="020a31c0-e1f0-441e-a375-54a0a168d797" containerName="istio-proxy" Jul 08 18:04:51.213745 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.213611 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="020a31c0-e1f0-441e-a375-54a0a168d797" containerName="istio-proxy" Jul 08 18:04:51.213816 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.213759 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="020a31c0-e1f0-441e-a375-54a0a168d797" containerName="istio-proxy" Jul 08 18:04:51.217950 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.217809 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" Jul 08 18:04:51.220658 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.220638 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-ddc77540-gw-openshift-default-dockercfg-vsfbf\"" Jul 08 18:04:51.232074 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.232007 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg"] Jul 08 18:04:51.306858 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.306825 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54ffa223-edff-4522-b002-59485be6a282-istio-token\") pod \"e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" Jul 08 18:04:51.306858 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.306860 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54ffa223-edff-4522-b002-59485be6a282-workload-certs\") pod \"e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" Jul 08 18:04:51.307072 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.306893 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54ffa223-edff-4522-b002-59485be6a282-workload-socket\") pod \"e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" Jul 08 18:04:51.307072 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.306910 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54ffa223-edff-4522-b002-59485be6a282-credential-socket\") pod \"e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" Jul 08 18:04:51.307072 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.306972 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54ffa223-edff-4522-b002-59485be6a282-istio-data\") pod \"e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" Jul 08 18:04:51.307072 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.307019 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dk9s\" (UniqueName: \"kubernetes.io/projected/54ffa223-edff-4522-b002-59485be6a282-kube-api-access-9dk9s\") pod \"e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" Jul 08 18:04:51.307072 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.307042 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54ffa223-edff-4522-b002-59485be6a282-istiod-ca-cert\") pod \"e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" Jul 08 18:04:51.307072 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.307068 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54ffa223-edff-4522-b002-59485be6a282-istio-envoy\") pod \"e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" Jul 08 18:04:51.307287 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.307086 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54ffa223-edff-4522-b002-59485be6a282-istio-podinfo\") pod \"e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" Jul 08 18:04:51.311469 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.311444 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:51.408052 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.407960 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54ffa223-edff-4522-b002-59485be6a282-istio-data\") pod \"e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" Jul 08 18:04:51.408052 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.408017 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dk9s\" (UniqueName: \"kubernetes.io/projected/54ffa223-edff-4522-b002-59485be6a282-kube-api-access-9dk9s\") pod \"e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" Jul 08 18:04:51.408052 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.408041 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54ffa223-edff-4522-b002-59485be6a282-istiod-ca-cert\") pod \"e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" Jul 08 18:04:51.408384 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.408075 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54ffa223-edff-4522-b002-59485be6a282-istio-envoy\") pod \"e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" Jul 08 18:04:51.408384 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.408091 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54ffa223-edff-4522-b002-59485be6a282-istio-podinfo\") pod \"e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" Jul 08 18:04:51.408495 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.408397 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54ffa223-edff-4522-b002-59485be6a282-istio-token\") pod \"e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" Jul 08 18:04:51.408495 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.408437 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54ffa223-edff-4522-b002-59485be6a282-workload-certs\") pod \"e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" Jul 08 18:04:51.408495 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.408448 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54ffa223-edff-4522-b002-59485be6a282-istio-data\") pod \"e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" Jul 08 18:04:51.408705 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.408564 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54ffa223-edff-4522-b002-59485be6a282-workload-socket\") pod \"e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" Jul 08 18:04:51.408705 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.408596 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54ffa223-edff-4522-b002-59485be6a282-credential-socket\") pod \"e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" Jul 08 18:04:51.408816 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.408764 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54ffa223-edff-4522-b002-59485be6a282-workload-certs\") pod \"e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" Jul 08 18:04:51.409023 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.408864 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54ffa223-edff-4522-b002-59485be6a282-istiod-ca-cert\") pod \"e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" Jul 08 18:04:51.409023 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.408936 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54ffa223-edff-4522-b002-59485be6a282-workload-socket\") pod \"e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" Jul 08 18:04:51.409023 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.408947 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54ffa223-edff-4522-b002-59485be6a282-credential-socket\") pod \"e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" Jul 08 18:04:51.410505 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.410483 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54ffa223-edff-4522-b002-59485be6a282-istio-envoy\") pod \"e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" Jul 08 18:04:51.410929 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.410911 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54ffa223-edff-4522-b002-59485be6a282-istio-podinfo\") pod \"e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" Jul 08 18:04:51.419673 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.419649 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54ffa223-edff-4522-b002-59485be6a282-istio-token\") pod \"e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" Jul 08 18:04:51.419842 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.419823 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dk9s\" (UniqueName: \"kubernetes.io/projected/54ffa223-edff-4522-b002-59485be6a282-kube-api-access-9dk9s\") pod \"e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" Jul 08 18:04:51.489598 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.489563 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:51.533363 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.533335 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" Jul 08 18:04:51.673027 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.673000 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg"] Jul 08 18:04:51.674615 ip-10-0-130-38 kubenswrapper[2552]: W0708 18:04:51.674588 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54ffa223_edff_4522_b002_59485be6a282.slice/crio-c4b484fa8c540c0b04440cc6907c74b98142e4f79837edb3cc7b2745732c945c WatchSource:0}: Error finding container c4b484fa8c540c0b04440cc6907c74b98142e4f79837edb3cc7b2745732c945c: Status 404 returned error can't find the container with id c4b484fa8c540c0b04440cc6907c74b98142e4f79837edb3cc7b2745732c945c Jul 08 18:04:51.677312 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.677265 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:04:51.677400 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.677368 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:04:51.677442 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.677414 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:04:51.761971 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.761937 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" event={"ID":"54ffa223-edff-4522-b002-59485be6a282","Type":"ContainerStarted","Data":"c49057862f30e06be78162bf76fd85a76a80e756cee6ec2f3f23b2099e928803"} Jul 08 18:04:51.762358 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.761994 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" event={"ID":"54ffa223-edff-4522-b002-59485be6a282","Type":"ContainerStarted","Data":"c4b484fa8c540c0b04440cc6907c74b98142e4f79837edb3cc7b2745732c945c"} Jul 08 18:04:51.798063 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:51.797993 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" podStartSLOduration=0.797970099 podStartE2EDuration="797.970099ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:04:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:04:51.79583554 +0000 UTC m=+1890.032227818" watchObservedRunningTime="2026-07-08 18:04:51.797970099 +0000 UTC m=+1890.034362355" Jul 08 18:04:52.307197 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:52.307164 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="020a31c0-e1f0-441e-a375-54a0a168d797" path="/var/lib/kubelet/pods/020a31c0-e1f0-441e-a375-54a0a168d797/volumes" Jul 08 18:04:52.495089 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:52.495056 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:52.533747 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:52.533721 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" Jul 08 18:04:52.538638 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:52.538616 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" Jul 08 18:04:52.597003 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:52.596911 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:52.767488 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:52.767454 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" Jul 08 18:04:52.768489 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:52.768473 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" Jul 08 18:04:52.841979 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:52.841942 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:53.714864 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:53.714831 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:53.777324 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:53.777291 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:55.331803 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:55.331774 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:57.082467 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:57.082435 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:57.260964 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:57.260926 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg"] Jul 08 18:04:57.261142 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:57.261119 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" podUID="54ffa223-edff-4522-b002-59485be6a282" containerName="istio-proxy" containerID="cri-o://c49057862f30e06be78162bf76fd85a76a80e756cee6ec2f3f23b2099e928803" gracePeriod=30 Jul 08 18:04:57.284649 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:57.284607 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:57.382267 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:57.382157 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:57.449714 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:57.449671 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:04:59.478892 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:04:59.478860 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:02.509415 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.509391 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" Jul 08 18:05:02.614303 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.614219 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54ffa223-edff-4522-b002-59485be6a282-workload-certs\") pod \"54ffa223-edff-4522-b002-59485be6a282\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " Jul 08 18:05:02.614303 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.614251 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54ffa223-edff-4522-b002-59485be6a282-istio-podinfo\") pod \"54ffa223-edff-4522-b002-59485be6a282\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " Jul 08 18:05:02.614303 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.614279 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54ffa223-edff-4522-b002-59485be6a282-workload-socket\") pod \"54ffa223-edff-4522-b002-59485be6a282\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " Jul 08 18:05:02.614303 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.614298 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54ffa223-edff-4522-b002-59485be6a282-istio-data\") pod \"54ffa223-edff-4522-b002-59485be6a282\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " Jul 08 18:05:02.614683 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.614345 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dk9s\" (UniqueName: \"kubernetes.io/projected/54ffa223-edff-4522-b002-59485be6a282-kube-api-access-9dk9s\") pod \"54ffa223-edff-4522-b002-59485be6a282\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " Jul 08 18:05:02.614683 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.614363 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54ffa223-edff-4522-b002-59485be6a282-istio-envoy\") pod \"54ffa223-edff-4522-b002-59485be6a282\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " Jul 08 18:05:02.614683 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.614446 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54ffa223-edff-4522-b002-59485be6a282-credential-socket\") pod \"54ffa223-edff-4522-b002-59485be6a282\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " Jul 08 18:05:02.614683 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.614475 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54ffa223-edff-4522-b002-59485be6a282-istio-token\") pod \"54ffa223-edff-4522-b002-59485be6a282\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " Jul 08 18:05:02.614683 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.614510 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54ffa223-edff-4522-b002-59485be6a282-istiod-ca-cert\") pod \"54ffa223-edff-4522-b002-59485be6a282\" (UID: \"54ffa223-edff-4522-b002-59485be6a282\") " Jul 08 18:05:02.614683 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.614585 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54ffa223-edff-4522-b002-59485be6a282-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "54ffa223-edff-4522-b002-59485be6a282" (UID: "54ffa223-edff-4522-b002-59485be6a282"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:05:02.614683 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.614653 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54ffa223-edff-4522-b002-59485be6a282-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "54ffa223-edff-4522-b002-59485be6a282" (UID: "54ffa223-edff-4522-b002-59485be6a282"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:05:02.614992 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.614732 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54ffa223-edff-4522-b002-59485be6a282-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "54ffa223-edff-4522-b002-59485be6a282" (UID: "54ffa223-edff-4522-b002-59485be6a282"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:05:02.614992 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.614779 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54ffa223-edff-4522-b002-59485be6a282-istio-data" (OuterVolumeSpecName: "istio-data") pod "54ffa223-edff-4522-b002-59485be6a282" (UID: "54ffa223-edff-4522-b002-59485be6a282"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:05:02.614992 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.614894 2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/54ffa223-edff-4522-b002-59485be6a282-workload-certs\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:05:02.614992 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.614912 2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/54ffa223-edff-4522-b002-59485be6a282-workload-socket\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:05:02.614992 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.614926 2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/54ffa223-edff-4522-b002-59485be6a282-istio-data\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:05:02.614992 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.614940 2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/54ffa223-edff-4522-b002-59485be6a282-credential-socket\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:05:02.614992 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.614924 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54ffa223-edff-4522-b002-59485be6a282-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "54ffa223-edff-4522-b002-59485be6a282" (UID: "54ffa223-edff-4522-b002-59485be6a282"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:05:02.616933 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.616903 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54ffa223-edff-4522-b002-59485be6a282-istio-token" (OuterVolumeSpecName: "istio-token") pod "54ffa223-edff-4522-b002-59485be6a282" (UID: "54ffa223-edff-4522-b002-59485be6a282"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:05:02.617030 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.616964 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54ffa223-edff-4522-b002-59485be6a282-kube-api-access-9dk9s" (OuterVolumeSpecName: "kube-api-access-9dk9s") pod "54ffa223-edff-4522-b002-59485be6a282" (UID: "54ffa223-edff-4522-b002-59485be6a282"). InnerVolumeSpecName "kube-api-access-9dk9s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:05:02.617152 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.617134 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/54ffa223-edff-4522-b002-59485be6a282-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "54ffa223-edff-4522-b002-59485be6a282" (UID: "54ffa223-edff-4522-b002-59485be6a282"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 18:05:02.617246 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.617228 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54ffa223-edff-4522-b002-59485be6a282-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "54ffa223-edff-4522-b002-59485be6a282" (UID: "54ffa223-edff-4522-b002-59485be6a282"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:05:02.716064 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.716015 2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/54ffa223-edff-4522-b002-59485be6a282-istio-token\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:05:02.716064 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.716059 2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/54ffa223-edff-4522-b002-59485be6a282-istiod-ca-cert\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:05:02.716064 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.716068 2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/54ffa223-edff-4522-b002-59485be6a282-istio-podinfo\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:05:02.716308 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.716076 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dk9s\" (UniqueName: \"kubernetes.io/projected/54ffa223-edff-4522-b002-59485be6a282-kube-api-access-9dk9s\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:05:02.716308 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.716086 2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/54ffa223-edff-4522-b002-59485be6a282-istio-envoy\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:05:02.818634 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.818598 2552 generic.go:356] "Generic (PLEG): container finished" podID="54ffa223-edff-4522-b002-59485be6a282" containerID="c49057862f30e06be78162bf76fd85a76a80e756cee6ec2f3f23b2099e928803" exitCode=0 Jul 08 18:05:02.818806 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.818640 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" Jul 08 18:05:02.818806 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.818662 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" event={"ID":"54ffa223-edff-4522-b002-59485be6a282","Type":"ContainerDied","Data":"c49057862f30e06be78162bf76fd85a76a80e756cee6ec2f3f23b2099e928803"} Jul 08 18:05:02.818806 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.818713 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg" event={"ID":"54ffa223-edff-4522-b002-59485be6a282","Type":"ContainerDied","Data":"c4b484fa8c540c0b04440cc6907c74b98142e4f79837edb3cc7b2745732c945c"} Jul 08 18:05:02.818806 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.818737 2552 scope.go:117] "RemoveContainer" containerID="c49057862f30e06be78162bf76fd85a76a80e756cee6ec2f3f23b2099e928803" Jul 08 18:05:02.829053 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.829031 2552 scope.go:117] "RemoveContainer" containerID="c49057862f30e06be78162bf76fd85a76a80e756cee6ec2f3f23b2099e928803" Jul 08 18:05:02.829324 ip-10-0-130-38 kubenswrapper[2552]: E0708 18:05:02.829307 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c49057862f30e06be78162bf76fd85a76a80e756cee6ec2f3f23b2099e928803\": container with ID starting with c49057862f30e06be78162bf76fd85a76a80e756cee6ec2f3f23b2099e928803 not found: ID does not exist" containerID="c49057862f30e06be78162bf76fd85a76a80e756cee6ec2f3f23b2099e928803" Jul 08 18:05:02.829398 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.829331 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c49057862f30e06be78162bf76fd85a76a80e756cee6ec2f3f23b2099e928803"} err="failed to get container status \"c49057862f30e06be78162bf76fd85a76a80e756cee6ec2f3f23b2099e928803\": rpc error: code = NotFound desc = could not find container \"c49057862f30e06be78162bf76fd85a76a80e756cee6ec2f3f23b2099e928803\": container with ID starting with c49057862f30e06be78162bf76fd85a76a80e756cee6ec2f3f23b2099e928803 not found: ID does not exist" Jul 08 18:05:02.843343 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.843313 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg"] Jul 08 18:05:02.850572 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:02.850530 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-ddc77540-gw-openshift-default-5bf6996699-6m5hg"] Jul 08 18:05:03.963492 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:03.963455 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:04.038129 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.038096 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:04.165249 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.165212 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5"] Jul 08 18:05:04.165774 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.165753 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54ffa223-edff-4522-b002-59485be6a282" containerName="istio-proxy" Jul 08 18:05:04.165774 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.165774 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="54ffa223-edff-4522-b002-59485be6a282" containerName="istio-proxy" Jul 08 18:05:04.165955 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.165894 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="54ffa223-edff-4522-b002-59485be6a282" containerName="istio-proxy" Jul 08 18:05:04.168819 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.168796 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" Jul 08 18:05:04.171644 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.171617 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-05d0f1bc-openshift-default-dockercfg-7fcqr\"" Jul 08 18:05:04.190778 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.190738 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5"] Jul 08 18:05:04.208390 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.208360 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:04.228745 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.228667 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15550bbf-3bbd-4780-be88-68b595563b48-workload-socket\") pod \"e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" Jul 08 18:05:04.228745 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.228736 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15550bbf-3bbd-4780-be88-68b595563b48-credential-socket\") pod \"e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" Jul 08 18:05:04.228912 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.228777 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15550bbf-3bbd-4780-be88-68b595563b48-istio-token\") pod \"e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" Jul 08 18:05:04.228912 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.228854 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15550bbf-3bbd-4780-be88-68b595563b48-workload-certs\") pod \"e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" Jul 08 18:05:04.228912 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.228905 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15550bbf-3bbd-4780-be88-68b595563b48-istio-envoy\") pod \"e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" Jul 08 18:05:04.229003 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.228971 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15550bbf-3bbd-4780-be88-68b595563b48-istio-data\") pod \"e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" Jul 08 18:05:04.229003 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.228995 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15550bbf-3bbd-4780-be88-68b595563b48-istiod-ca-cert\") pod \"e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" Jul 08 18:05:04.229070 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.229032 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15550bbf-3bbd-4780-be88-68b595563b48-istio-podinfo\") pod \"e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" Jul 08 18:05:04.229104 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.229077 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrqjz\" (UniqueName: \"kubernetes.io/projected/15550bbf-3bbd-4780-be88-68b595563b48-kube-api-access-rrqjz\") pod \"e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" Jul 08 18:05:04.306128 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.306086 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:04.307526 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.307502 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54ffa223-edff-4522-b002-59485be6a282" path="/var/lib/kubelet/pods/54ffa223-edff-4522-b002-59485be6a282/volumes" Jul 08 18:05:04.330527 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.330494 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15550bbf-3bbd-4780-be88-68b595563b48-workload-certs\") pod \"e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" Jul 08 18:05:04.330527 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.330528 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15550bbf-3bbd-4780-be88-68b595563b48-istio-envoy\") pod \"e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" Jul 08 18:05:04.330804 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.330571 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15550bbf-3bbd-4780-be88-68b595563b48-istio-data\") pod \"e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" Jul 08 18:05:04.330804 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.330588 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15550bbf-3bbd-4780-be88-68b595563b48-istiod-ca-cert\") pod \"e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" Jul 08 18:05:04.330804 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.330623 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15550bbf-3bbd-4780-be88-68b595563b48-istio-podinfo\") pod \"e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" Jul 08 18:05:04.330804 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.330653 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrqjz\" (UniqueName: \"kubernetes.io/projected/15550bbf-3bbd-4780-be88-68b595563b48-kube-api-access-rrqjz\") pod \"e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" Jul 08 18:05:04.330804 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.330711 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15550bbf-3bbd-4780-be88-68b595563b48-workload-socket\") pod \"e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" Jul 08 18:05:04.330804 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.330759 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15550bbf-3bbd-4780-be88-68b595563b48-credential-socket\") pod \"e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" Jul 08 18:05:04.330804 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.330799 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15550bbf-3bbd-4780-be88-68b595563b48-istio-token\") pod \"e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" Jul 08 18:05:04.331210 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.331006 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15550bbf-3bbd-4780-be88-68b595563b48-istio-data\") pod \"e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" Jul 08 18:05:04.331210 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.331035 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15550bbf-3bbd-4780-be88-68b595563b48-workload-certs\") pod \"e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" Jul 08 18:05:04.331210 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.331086 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15550bbf-3bbd-4780-be88-68b595563b48-credential-socket\") pod \"e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" Jul 08 18:05:04.331210 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.331149 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15550bbf-3bbd-4780-be88-68b595563b48-workload-socket\") pod \"e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" Jul 08 18:05:04.331582 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.331530 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15550bbf-3bbd-4780-be88-68b595563b48-istiod-ca-cert\") pod \"e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" Jul 08 18:05:04.333153 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.333132 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15550bbf-3bbd-4780-be88-68b595563b48-istio-envoy\") pod \"e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" Jul 08 18:05:04.333649 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.333630 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15550bbf-3bbd-4780-be88-68b595563b48-istio-podinfo\") pod \"e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" Jul 08 18:05:04.342234 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.342211 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrqjz\" (UniqueName: \"kubernetes.io/projected/15550bbf-3bbd-4780-be88-68b595563b48-kube-api-access-rrqjz\") pod \"e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" Jul 08 18:05:04.342234 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.342222 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15550bbf-3bbd-4780-be88-68b595563b48-istio-token\") pod \"e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" Jul 08 18:05:04.483397 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.483305 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" Jul 08 18:05:04.628010 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.627978 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5"] Jul 08 18:05:04.628613 ip-10-0-130-38 kubenswrapper[2552]: W0708 18:05:04.628582 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15550bbf_3bbd_4780_be88_68b595563b48.slice/crio-0ff6c8a3b06361f591aee45ed518ad2708c5140c5f321a7eb235c4e1014fe2db WatchSource:0}: Error finding container 0ff6c8a3b06361f591aee45ed518ad2708c5140c5f321a7eb235c4e1014fe2db: Status 404 returned error can't find the container with id 0ff6c8a3b06361f591aee45ed518ad2708c5140c5f321a7eb235c4e1014fe2db Jul 08 18:05:04.630869 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.630837 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:05:04.630935 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.630906 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:05:04.630978 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.630936 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:05:04.833581 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.833483 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" event={"ID":"15550bbf-3bbd-4780-be88-68b595563b48","Type":"ContainerStarted","Data":"1589e5ace8e3a54a5946225366652d9144d58ca5a4b1d82aed3a166b3575e769"} Jul 08 18:05:04.833581 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.833558 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" event={"ID":"15550bbf-3bbd-4780-be88-68b595563b48","Type":"ContainerStarted","Data":"0ff6c8a3b06361f591aee45ed518ad2708c5140c5f321a7eb235c4e1014fe2db"} Jul 08 18:05:04.858440 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:04.858387 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" podStartSLOduration=0.858369292 podStartE2EDuration="858.369292ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:05:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:05:04.85560999 +0000 UTC m=+1903.092002244" watchObservedRunningTime="2026-07-08 18:05:04.858369292 +0000 UTC m=+1903.094761546" Jul 08 18:05:05.413144 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:05.413112 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:05.484345 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:05.484304 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" Jul 08 18:05:05.489436 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:05.489409 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" Jul 08 18:05:05.646660 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:05.646626 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:05.726923 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:05.726889 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:05.838779 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:05.838742 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" Jul 08 18:05:05.839809 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:05.839785 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" Jul 08 18:05:05.843768 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:05.843748 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:06.321217 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:06.321175 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:06.421204 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:06.421171 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:08.064152 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:08.064124 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:10.552127 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:10.552081 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:11.099968 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:11.099934 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:16.722437 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:16.722395 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5"] Jul 08 18:05:16.722869 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:16.722729 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" podUID="15550bbf-3bbd-4780-be88-68b595563b48" containerName="istio-proxy" containerID="cri-o://1589e5ace8e3a54a5946225366652d9144d58ca5a4b1d82aed3a166b3575e769" gracePeriod=30 Jul 08 18:05:16.763994 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:16.763955 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:16.864080 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:16.864045 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:17.175124 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.175102 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" Jul 08 18:05:17.347788 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.347752 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15550bbf-3bbd-4780-be88-68b595563b48-istio-podinfo\") pod \"15550bbf-3bbd-4780-be88-68b595563b48\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " Jul 08 18:05:17.347970 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.347810 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15550bbf-3bbd-4780-be88-68b595563b48-istio-envoy\") pod \"15550bbf-3bbd-4780-be88-68b595563b48\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " Jul 08 18:05:17.347970 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.347831 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15550bbf-3bbd-4780-be88-68b595563b48-istio-data\") pod \"15550bbf-3bbd-4780-be88-68b595563b48\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " Jul 08 18:05:17.347970 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.347860 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15550bbf-3bbd-4780-be88-68b595563b48-credential-socket\") pod \"15550bbf-3bbd-4780-be88-68b595563b48\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " Jul 08 18:05:17.347970 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.347904 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrqjz\" (UniqueName: \"kubernetes.io/projected/15550bbf-3bbd-4780-be88-68b595563b48-kube-api-access-rrqjz\") pod \"15550bbf-3bbd-4780-be88-68b595563b48\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " Jul 08 18:05:17.347970 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.347949 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15550bbf-3bbd-4780-be88-68b595563b48-workload-socket\") pod \"15550bbf-3bbd-4780-be88-68b595563b48\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " Jul 08 18:05:17.347970 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.347965 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15550bbf-3bbd-4780-be88-68b595563b48-istio-token\") pod \"15550bbf-3bbd-4780-be88-68b595563b48\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " Jul 08 18:05:17.348294 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.347981 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15550bbf-3bbd-4780-be88-68b595563b48-istiod-ca-cert\") pod \"15550bbf-3bbd-4780-be88-68b595563b48\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " Jul 08 18:05:17.348294 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.348008 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15550bbf-3bbd-4780-be88-68b595563b48-workload-certs\") pod \"15550bbf-3bbd-4780-be88-68b595563b48\" (UID: \"15550bbf-3bbd-4780-be88-68b595563b48\") " Jul 08 18:05:17.348294 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.348153 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15550bbf-3bbd-4780-be88-68b595563b48-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "15550bbf-3bbd-4780-be88-68b595563b48" (UID: "15550bbf-3bbd-4780-be88-68b595563b48"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:05:17.348463 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.348327 2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15550bbf-3bbd-4780-be88-68b595563b48-credential-socket\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:05:17.348685 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.348662 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15550bbf-3bbd-4780-be88-68b595563b48-istio-data" (OuterVolumeSpecName: "istio-data") pod "15550bbf-3bbd-4780-be88-68b595563b48" (UID: "15550bbf-3bbd-4780-be88-68b595563b48"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:05:17.349839 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.349807 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15550bbf-3bbd-4780-be88-68b595563b48-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "15550bbf-3bbd-4780-be88-68b595563b48" (UID: "15550bbf-3bbd-4780-be88-68b595563b48"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:05:17.349970 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.349856 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15550bbf-3bbd-4780-be88-68b595563b48-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "15550bbf-3bbd-4780-be88-68b595563b48" (UID: "15550bbf-3bbd-4780-be88-68b595563b48"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:05:17.349970 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.349953 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15550bbf-3bbd-4780-be88-68b595563b48-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "15550bbf-3bbd-4780-be88-68b595563b48" (UID: "15550bbf-3bbd-4780-be88-68b595563b48"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:05:17.350198 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.350174 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/15550bbf-3bbd-4780-be88-68b595563b48-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "15550bbf-3bbd-4780-be88-68b595563b48" (UID: "15550bbf-3bbd-4780-be88-68b595563b48"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 18:05:17.350405 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.350387 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15550bbf-3bbd-4780-be88-68b595563b48-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "15550bbf-3bbd-4780-be88-68b595563b48" (UID: "15550bbf-3bbd-4780-be88-68b595563b48"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:05:17.351456 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.351431 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15550bbf-3bbd-4780-be88-68b595563b48-kube-api-access-rrqjz" (OuterVolumeSpecName: "kube-api-access-rrqjz") pod "15550bbf-3bbd-4780-be88-68b595563b48" (UID: "15550bbf-3bbd-4780-be88-68b595563b48"). InnerVolumeSpecName "kube-api-access-rrqjz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:05:17.351627 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.351610 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15550bbf-3bbd-4780-be88-68b595563b48-istio-token" (OuterVolumeSpecName: "istio-token") pod "15550bbf-3bbd-4780-be88-68b595563b48" (UID: "15550bbf-3bbd-4780-be88-68b595563b48"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:05:17.449470 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.449437 2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15550bbf-3bbd-4780-be88-68b595563b48-workload-socket\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:05:17.449470 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.449465 2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15550bbf-3bbd-4780-be88-68b595563b48-istio-token\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:05:17.449470 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.449476 2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15550bbf-3bbd-4780-be88-68b595563b48-istiod-ca-cert\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:05:17.449714 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.449484 2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15550bbf-3bbd-4780-be88-68b595563b48-workload-certs\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:05:17.449714 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.449492 2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15550bbf-3bbd-4780-be88-68b595563b48-istio-podinfo\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:05:17.449714 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.449499 2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15550bbf-3bbd-4780-be88-68b595563b48-istio-envoy\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:05:17.449714 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.449507 2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15550bbf-3bbd-4780-be88-68b595563b48-istio-data\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:05:17.449714 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.449514 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrqjz\" (UniqueName: \"kubernetes.io/projected/15550bbf-3bbd-4780-be88-68b595563b48-kube-api-access-rrqjz\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:05:17.906029 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.905995 2552 generic.go:356] "Generic (PLEG): container finished" podID="15550bbf-3bbd-4780-be88-68b595563b48" containerID="1589e5ace8e3a54a5946225366652d9144d58ca5a4b1d82aed3a166b3575e769" exitCode=0 Jul 08 18:05:17.906426 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.906038 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" Jul 08 18:05:17.906426 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.906086 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" event={"ID":"15550bbf-3bbd-4780-be88-68b595563b48","Type":"ContainerDied","Data":"1589e5ace8e3a54a5946225366652d9144d58ca5a4b1d82aed3a166b3575e769"} Jul 08 18:05:17.906426 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.906138 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5" event={"ID":"15550bbf-3bbd-4780-be88-68b595563b48","Type":"ContainerDied","Data":"0ff6c8a3b06361f591aee45ed518ad2708c5140c5f321a7eb235c4e1014fe2db"} Jul 08 18:05:17.906426 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.906165 2552 scope.go:117] "RemoveContainer" containerID="1589e5ace8e3a54a5946225366652d9144d58ca5a4b1d82aed3a166b3575e769" Jul 08 18:05:17.917818 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.917525 2552 scope.go:117] "RemoveContainer" containerID="1589e5ace8e3a54a5946225366652d9144d58ca5a4b1d82aed3a166b3575e769" Jul 08 18:05:17.918203 ip-10-0-130-38 kubenswrapper[2552]: E0708 18:05:17.918170 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1589e5ace8e3a54a5946225366652d9144d58ca5a4b1d82aed3a166b3575e769\": container with ID starting with 1589e5ace8e3a54a5946225366652d9144d58ca5a4b1d82aed3a166b3575e769 not found: ID does not exist" containerID="1589e5ace8e3a54a5946225366652d9144d58ca5a4b1d82aed3a166b3575e769" Jul 08 18:05:17.918298 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.918213 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1589e5ace8e3a54a5946225366652d9144d58ca5a4b1d82aed3a166b3575e769"} err="failed to get container status \"1589e5ace8e3a54a5946225366652d9144d58ca5a4b1d82aed3a166b3575e769\": rpc error: code = NotFound desc = could not find container \"1589e5ace8e3a54a5946225366652d9144d58ca5a4b1d82aed3a166b3575e769\": container with ID starting with 1589e5ace8e3a54a5946225366652d9144d58ca5a4b1d82aed3a166b3575e769 not found: ID does not exist" Jul 08 18:05:17.929184 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.929154 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5"] Jul 08 18:05:17.934201 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:17.934181 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-05d0f1bc-openshift-default-866f49f8b9-27vr5"] Jul 08 18:05:18.307442 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:18.307398 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15550bbf-3bbd-4780-be88-68b595563b48" path="/var/lib/kubelet/pods/15550bbf-3bbd-4780-be88-68b595563b48/volumes" Jul 08 18:05:19.383409 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:19.383379 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:23.240414 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.240374 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:23.309160 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.309132 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:23.443036 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.443004 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw"] Jul 08 18:05:23.443427 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.443413 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15550bbf-3bbd-4780-be88-68b595563b48" containerName="istio-proxy" Jul 08 18:05:23.443499 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.443429 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="15550bbf-3bbd-4780-be88-68b595563b48" containerName="istio-proxy" Jul 08 18:05:23.443582 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.443507 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="15550bbf-3bbd-4780-be88-68b595563b48" containerName="istio-proxy" Jul 08 18:05:23.446896 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.446875 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" Jul 08 18:05:23.449475 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.449452 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-fe39ee72-openshift-default-dockercfg-klrl8\"" Jul 08 18:05:23.465452 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.465431 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw"] Jul 08 18:05:23.479167 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.479143 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:23.578965 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.578889 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:23.606111 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.606077 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31044c69-60f9-473d-b106-79735a6d36e0-workload-socket\") pod \"e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" Jul 08 18:05:23.606198 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.606123 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31044c69-60f9-473d-b106-79735a6d36e0-istio-podinfo\") pod \"e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" Jul 08 18:05:23.606198 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.606162 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31044c69-60f9-473d-b106-79735a6d36e0-istio-data\") pod \"e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" Jul 08 18:05:23.606279 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.606211 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31044c69-60f9-473d-b106-79735a6d36e0-istio-token\") pod \"e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" Jul 08 18:05:23.606279 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.606256 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31044c69-60f9-473d-b106-79735a6d36e0-istio-envoy\") pod \"e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" Jul 08 18:05:23.606346 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.606291 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntbkr\" (UniqueName: \"kubernetes.io/projected/31044c69-60f9-473d-b106-79735a6d36e0-kube-api-access-ntbkr\") pod \"e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" Jul 08 18:05:23.606346 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.606317 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31044c69-60f9-473d-b106-79735a6d36e0-istiod-ca-cert\") pod \"e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" Jul 08 18:05:23.606405 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.606354 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31044c69-60f9-473d-b106-79735a6d36e0-workload-certs\") pod \"e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" Jul 08 18:05:23.606440 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.606410 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31044c69-60f9-473d-b106-79735a6d36e0-credential-socket\") pod \"e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" Jul 08 18:05:23.707710 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.707675 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31044c69-60f9-473d-b106-79735a6d36e0-workload-socket\") pod \"e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" Jul 08 18:05:23.707710 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.707714 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31044c69-60f9-473d-b106-79735a6d36e0-istio-podinfo\") pod \"e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" Jul 08 18:05:23.707946 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.707741 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31044c69-60f9-473d-b106-79735a6d36e0-istio-data\") pod \"e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" Jul 08 18:05:23.707946 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.707774 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31044c69-60f9-473d-b106-79735a6d36e0-istio-token\") pod \"e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" Jul 08 18:05:23.707946 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.707789 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31044c69-60f9-473d-b106-79735a6d36e0-istio-envoy\") pod \"e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" Jul 08 18:05:23.707946 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.707809 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntbkr\" (UniqueName: \"kubernetes.io/projected/31044c69-60f9-473d-b106-79735a6d36e0-kube-api-access-ntbkr\") pod \"e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" Jul 08 18:05:23.707946 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.707838 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31044c69-60f9-473d-b106-79735a6d36e0-istiod-ca-cert\") pod \"e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" Jul 08 18:05:23.707946 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.707885 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31044c69-60f9-473d-b106-79735a6d36e0-workload-certs\") pod \"e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" Jul 08 18:05:23.707946 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.707927 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31044c69-60f9-473d-b106-79735a6d36e0-credential-socket\") pod \"e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" Jul 08 18:05:23.708305 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.708252 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31044c69-60f9-473d-b106-79735a6d36e0-istio-data\") pod \"e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" Jul 08 18:05:23.708363 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.708299 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31044c69-60f9-473d-b106-79735a6d36e0-credential-socket\") pod \"e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" Jul 08 18:05:23.708363 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.708326 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31044c69-60f9-473d-b106-79735a6d36e0-workload-certs\") pod \"e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" Jul 08 18:05:23.708464 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.708362 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31044c69-60f9-473d-b106-79735a6d36e0-workload-socket\") pod \"e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" Jul 08 18:05:23.708684 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.708562 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31044c69-60f9-473d-b106-79735a6d36e0-istiod-ca-cert\") pod \"e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" Jul 08 18:05:23.710273 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.710247 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31044c69-60f9-473d-b106-79735a6d36e0-istio-envoy\") pod \"e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" Jul 08 18:05:23.710471 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.710453 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31044c69-60f9-473d-b106-79735a6d36e0-istio-podinfo\") pod \"e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" Jul 08 18:05:23.715574 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.715550 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31044c69-60f9-473d-b106-79735a6d36e0-istio-token\") pod \"e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" Jul 08 18:05:23.715696 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.715677 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntbkr\" (UniqueName: \"kubernetes.io/projected/31044c69-60f9-473d-b106-79735a6d36e0-kube-api-access-ntbkr\") pod \"e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" Jul 08 18:05:23.758209 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.758182 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" Jul 08 18:05:23.902434 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.902341 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw"] Jul 08 18:05:23.904747 ip-10-0-130-38 kubenswrapper[2552]: W0708 18:05:23.904705 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31044c69_60f9_473d_b106_79735a6d36e0.slice/crio-1a69812bef4a0fbc8097e1bfc9addd5fc4932b49f8f7433bfaf1203b54d13f0e WatchSource:0}: Error finding container 1a69812bef4a0fbc8097e1bfc9addd5fc4932b49f8f7433bfaf1203b54d13f0e: Status 404 returned error can't find the container with id 1a69812bef4a0fbc8097e1bfc9addd5fc4932b49f8f7433bfaf1203b54d13f0e Jul 08 18:05:23.906914 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.906881 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:05:23.907000 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.906946 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:05:23.907000 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.906979 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:05:23.946663 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:23.946637 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" event={"ID":"31044c69-60f9-473d-b106-79735a6d36e0","Type":"ContainerStarted","Data":"1a69812bef4a0fbc8097e1bfc9addd5fc4932b49f8f7433bfaf1203b54d13f0e"} Jul 08 18:05:24.595045 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:24.595000 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:24.689839 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:24.689798 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:24.953300 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:24.953259 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" event={"ID":"31044c69-60f9-473d-b106-79735a6d36e0","Type":"ContainerStarted","Data":"95033a80b249c10163aad0437644de44e65fb2de0b571f975b6e1fe97cf89bd0"} Jul 08 18:05:24.959235 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:24.959214 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:25.001693 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:25.001642 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" podStartSLOduration=2.001624514 podStartE2EDuration="2.001624514s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:05:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:05:24.994225559 +0000 UTC m=+1923.230617825" watchObservedRunningTime="2026-07-08 18:05:25.001624514 +0000 UTC m=+1923.238016769" Jul 08 18:05:25.264954 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:25.264865 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:25.463973 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:25.463928 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:25.564468 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:25.564322 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:25.759275 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:25.759234 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" Jul 08 18:05:25.764756 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:25.764729 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" Jul 08 18:05:25.958780 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:25.958745 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" Jul 08 18:05:25.959814 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:25.959793 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" Jul 08 18:05:27.239817 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:27.239789 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:29.045605 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:29.045560 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:29.203732 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:29.203693 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw"] Jul 08 18:05:29.203904 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:29.203887 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" podUID="31044c69-60f9-473d-b106-79735a6d36e0" containerName="istio-proxy" containerID="cri-o://95033a80b249c10163aad0437644de44e65fb2de0b571f975b6e1fe97cf89bd0" gracePeriod=30 Jul 08 18:05:29.220474 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:29.220443 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:29.334125 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:29.334021 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:29.418497 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:29.418458 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:31.122847 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:31.122811 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:34.479909 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:34.479884 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" Jul 08 18:05:34.505758 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:34.505724 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31044c69-60f9-473d-b106-79735a6d36e0-istio-data\") pod \"31044c69-60f9-473d-b106-79735a6d36e0\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " Jul 08 18:05:34.505923 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:34.505807 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31044c69-60f9-473d-b106-79735a6d36e0-credential-socket\") pod \"31044c69-60f9-473d-b106-79735a6d36e0\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " Jul 08 18:05:34.505923 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:34.505857 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31044c69-60f9-473d-b106-79735a6d36e0-istio-podinfo\") pod \"31044c69-60f9-473d-b106-79735a6d36e0\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " Jul 08 18:05:34.505923 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:34.505904 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31044c69-60f9-473d-b106-79735a6d36e0-istio-envoy\") pod \"31044c69-60f9-473d-b106-79735a6d36e0\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " Jul 08 18:05:34.506078 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:34.506046 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31044c69-60f9-473d-b106-79735a6d36e0-workload-certs\") pod \"31044c69-60f9-473d-b106-79735a6d36e0\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " Jul 08 18:05:34.506129 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:34.506080 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31044c69-60f9-473d-b106-79735a6d36e0-workload-socket\") pod \"31044c69-60f9-473d-b106-79735a6d36e0\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " Jul 08 18:05:34.506129 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:34.506108 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31044c69-60f9-473d-b106-79735a6d36e0-istio-token\") pod \"31044c69-60f9-473d-b106-79735a6d36e0\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " Jul 08 18:05:34.506233 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:34.506131 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ntbkr\" (UniqueName: \"kubernetes.io/projected/31044c69-60f9-473d-b106-79735a6d36e0-kube-api-access-ntbkr\") pod \"31044c69-60f9-473d-b106-79735a6d36e0\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " Jul 08 18:05:34.506233 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:34.506175 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31044c69-60f9-473d-b106-79735a6d36e0-istiod-ca-cert\") pod \"31044c69-60f9-473d-b106-79735a6d36e0\" (UID: \"31044c69-60f9-473d-b106-79735a6d36e0\") " Jul 08 18:05:34.506233 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:34.506185 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31044c69-60f9-473d-b106-79735a6d36e0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "31044c69-60f9-473d-b106-79735a6d36e0" (UID: "31044c69-60f9-473d-b106-79735a6d36e0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:05:34.506383 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:34.506350 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31044c69-60f9-473d-b106-79735a6d36e0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "31044c69-60f9-473d-b106-79735a6d36e0" (UID: "31044c69-60f9-473d-b106-79735a6d36e0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:05:34.506521 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:34.506501 2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31044c69-60f9-473d-b106-79735a6d36e0-workload-socket\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:05:34.506684 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:34.506527 2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31044c69-60f9-473d-b106-79735a6d36e0-credential-socket\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:05:34.506684 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:34.506505 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31044c69-60f9-473d-b106-79735a6d36e0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "31044c69-60f9-473d-b106-79735a6d36e0" (UID: "31044c69-60f9-473d-b106-79735a6d36e0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:05:34.507087 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:34.506843 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31044c69-60f9-473d-b106-79735a6d36e0-istio-data" (OuterVolumeSpecName: "istio-data") pod "31044c69-60f9-473d-b106-79735a6d36e0" (UID: "31044c69-60f9-473d-b106-79735a6d36e0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:05:34.507174 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:34.507159 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31044c69-60f9-473d-b106-79735a6d36e0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "31044c69-60f9-473d-b106-79735a6d36e0" (UID: "31044c69-60f9-473d-b106-79735a6d36e0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:05:34.509099 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:34.509065 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31044c69-60f9-473d-b106-79735a6d36e0-kube-api-access-ntbkr" (OuterVolumeSpecName: "kube-api-access-ntbkr") pod "31044c69-60f9-473d-b106-79735a6d36e0" (UID: "31044c69-60f9-473d-b106-79735a6d36e0"). InnerVolumeSpecName "kube-api-access-ntbkr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:05:34.509199 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:34.509158 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/31044c69-60f9-473d-b106-79735a6d36e0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "31044c69-60f9-473d-b106-79735a6d36e0" (UID: "31044c69-60f9-473d-b106-79735a6d36e0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 18:05:34.509732 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:34.509700 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31044c69-60f9-473d-b106-79735a6d36e0-istio-token" (OuterVolumeSpecName: "istio-token") pod "31044c69-60f9-473d-b106-79735a6d36e0" (UID: "31044c69-60f9-473d-b106-79735a6d36e0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:05:34.509837 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:34.509763 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31044c69-60f9-473d-b106-79735a6d36e0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "31044c69-60f9-473d-b106-79735a6d36e0" (UID: "31044c69-60f9-473d-b106-79735a6d36e0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:05:34.607876 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:34.607837 2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31044c69-60f9-473d-b106-79735a6d36e0-istio-envoy\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:05:34.607876 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:34.607869 2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31044c69-60f9-473d-b106-79735a6d36e0-workload-certs\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:05:34.607876 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:34.607878 2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31044c69-60f9-473d-b106-79735a6d36e0-istio-token\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:05:34.607876 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:34.607886 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ntbkr\" (UniqueName: \"kubernetes.io/projected/31044c69-60f9-473d-b106-79735a6d36e0-kube-api-access-ntbkr\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:05:34.608173 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:34.607896 2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31044c69-60f9-473d-b106-79735a6d36e0-istiod-ca-cert\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:05:34.608173 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:34.607904 2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31044c69-60f9-473d-b106-79735a6d36e0-istio-data\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:05:34.608173 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:34.607911 2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31044c69-60f9-473d-b106-79735a6d36e0-istio-podinfo\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:05:35.007607 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:35.007574 2552 generic.go:356] "Generic (PLEG): container finished" podID="31044c69-60f9-473d-b106-79735a6d36e0" containerID="95033a80b249c10163aad0437644de44e65fb2de0b571f975b6e1fe97cf89bd0" exitCode=0 Jul 08 18:05:35.007784 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:35.007619 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" Jul 08 18:05:35.007784 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:35.007652 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" event={"ID":"31044c69-60f9-473d-b106-79735a6d36e0","Type":"ContainerDied","Data":"95033a80b249c10163aad0437644de44e65fb2de0b571f975b6e1fe97cf89bd0"} Jul 08 18:05:35.007784 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:35.007706 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw" event={"ID":"31044c69-60f9-473d-b106-79735a6d36e0","Type":"ContainerDied","Data":"1a69812bef4a0fbc8097e1bfc9addd5fc4932b49f8f7433bfaf1203b54d13f0e"} Jul 08 18:05:35.007784 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:35.007728 2552 scope.go:117] "RemoveContainer" containerID="95033a80b249c10163aad0437644de44e65fb2de0b571f975b6e1fe97cf89bd0" Jul 08 18:05:35.019069 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:35.019047 2552 scope.go:117] "RemoveContainer" containerID="95033a80b249c10163aad0437644de44e65fb2de0b571f975b6e1fe97cf89bd0" Jul 08 18:05:35.019377 ip-10-0-130-38 kubenswrapper[2552]: E0708 18:05:35.019357 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95033a80b249c10163aad0437644de44e65fb2de0b571f975b6e1fe97cf89bd0\": container with ID starting with 95033a80b249c10163aad0437644de44e65fb2de0b571f975b6e1fe97cf89bd0 not found: ID does not exist" containerID="95033a80b249c10163aad0437644de44e65fb2de0b571f975b6e1fe97cf89bd0" Jul 08 18:05:35.019442 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:35.019391 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95033a80b249c10163aad0437644de44e65fb2de0b571f975b6e1fe97cf89bd0"} err="failed to get container status \"95033a80b249c10163aad0437644de44e65fb2de0b571f975b6e1fe97cf89bd0\": rpc error: code = NotFound desc = could not find container \"95033a80b249c10163aad0437644de44e65fb2de0b571f975b6e1fe97cf89bd0\": container with ID starting with 95033a80b249c10163aad0437644de44e65fb2de0b571f975b6e1fe97cf89bd0 not found: ID does not exist" Jul 08 18:05:35.032528 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:35.032496 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw"] Jul 08 18:05:35.036487 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:35.036464 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-fe39ee72-openshift-default-69bd9bf7c5-fc2cw"] Jul 08 18:05:36.271816 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:36.271787 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:36.307215 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:36.307184 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31044c69-60f9-473d-b106-79735a6d36e0" path="/var/lib/kubelet/pods/31044c69-60f9-473d-b106-79735a6d36e0/volumes" Jul 08 18:05:36.372063 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:36.372034 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:36.787514 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:36.787471 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:36.881310 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:36.881276 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:36.978328 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:36.978293 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:38.478080 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:38.478044 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:45.260039 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:45.260001 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:45.366296 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:45.366253 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:45.464530 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:45.464493 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:45.565659 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:45.565559 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:05:46.022904 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:05:46.022869 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:06:05.337130 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:06:05.337093 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:06:05.436587 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:06:05.436527 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:06:12.032214 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:06:12.032176 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:06:18.869402 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:06:18.869319 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:06:18.981638 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:06:18.981607 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:06:19.124959 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:06:19.124865 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:06:35.039078 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:06:35.039039 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:06:42.272894 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:06:42.272856 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:06:42.396445 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:06:42.396407 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:06:42.488700 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:06:42.488667 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:06:53.030946 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:06:53.030904 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:06:53.884041 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:06:53.884005 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:00.907974 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:00.907929 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:01.016495 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:01.016456 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:01.109268 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:01.109236 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:01.210260 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:01.210230 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:02.127426 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:02.127396 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:02.230146 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:02.230119 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:03.841782 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:03.841746 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:10.206109 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:10.206076 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:10.284475 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:10.284436 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:10.915734 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:10.915701 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:17.769425 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:17.769392 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:17.867622 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:17.867589 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:18.024077 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.023987 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:18.327301 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.327222 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm"] Jul 08 18:07:18.327684 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.327664 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31044c69-60f9-473d-b106-79735a6d36e0" containerName="istio-proxy" Jul 08 18:07:18.327684 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.327684 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="31044c69-60f9-473d-b106-79735a6d36e0" containerName="istio-proxy" Jul 08 18:07:18.327869 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.327770 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="31044c69-60f9-473d-b106-79735a6d36e0" containerName="istio-proxy" Jul 08 18:07:18.329964 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.329946 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:18.332770 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.332752 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-a1cf05a8-openshift-default-dockercfg-n977z\"" Jul 08 18:07:18.362214 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.362188 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm"] Jul 08 18:07:18.431109 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.431070 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa764a03-d0fd-449b-b17b-8f38de784908-credential-socket\") pod \"e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:18.431304 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.431125 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa764a03-d0fd-449b-b17b-8f38de784908-istio-data\") pod \"e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:18.431304 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.431144 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa764a03-d0fd-449b-b17b-8f38de784908-workload-certs\") pod \"e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:18.431304 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.431209 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa764a03-d0fd-449b-b17b-8f38de784908-workload-socket\") pod \"e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:18.431304 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.431275 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtvf6\" (UniqueName: \"kubernetes.io/projected/fa764a03-d0fd-449b-b17b-8f38de784908-kube-api-access-qtvf6\") pod \"e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:18.431529 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.431333 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa764a03-d0fd-449b-b17b-8f38de784908-istiod-ca-cert\") pod \"e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:18.431529 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.431387 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa764a03-d0fd-449b-b17b-8f38de784908-istio-envoy\") pod \"e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:18.431529 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.431416 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa764a03-d0fd-449b-b17b-8f38de784908-istio-podinfo\") pod \"e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:18.431529 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.431442 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa764a03-d0fd-449b-b17b-8f38de784908-istio-token\") pod \"e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:18.532816 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.532779 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa764a03-d0fd-449b-b17b-8f38de784908-istio-data\") pod \"e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:18.532816 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.532814 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa764a03-d0fd-449b-b17b-8f38de784908-workload-certs\") pod \"e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:18.533053 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.532836 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa764a03-d0fd-449b-b17b-8f38de784908-workload-socket\") pod \"e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:18.533053 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.532866 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtvf6\" (UniqueName: \"kubernetes.io/projected/fa764a03-d0fd-449b-b17b-8f38de784908-kube-api-access-qtvf6\") pod \"e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:18.533053 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.532911 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa764a03-d0fd-449b-b17b-8f38de784908-istiod-ca-cert\") pod \"e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:18.533053 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.532957 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa764a03-d0fd-449b-b17b-8f38de784908-istio-envoy\") pod \"e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:18.533053 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.532984 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa764a03-d0fd-449b-b17b-8f38de784908-istio-podinfo\") pod \"e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:18.533053 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.533006 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa764a03-d0fd-449b-b17b-8f38de784908-istio-token\") pod \"e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:18.533371 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.533063 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa764a03-d0fd-449b-b17b-8f38de784908-credential-socket\") pod \"e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:18.533371 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.533157 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa764a03-d0fd-449b-b17b-8f38de784908-istio-data\") pod \"e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:18.533371 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.533230 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa764a03-d0fd-449b-b17b-8f38de784908-workload-certs\") pod \"e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:18.533371 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.533280 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa764a03-d0fd-449b-b17b-8f38de784908-workload-socket\") pod \"e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:18.533614 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.533402 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa764a03-d0fd-449b-b17b-8f38de784908-credential-socket\") pod \"e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:18.533901 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.533882 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa764a03-d0fd-449b-b17b-8f38de784908-istiod-ca-cert\") pod \"e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:18.535588 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.535565 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa764a03-d0fd-449b-b17b-8f38de784908-istio-envoy\") pod \"e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:18.535768 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.535750 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa764a03-d0fd-449b-b17b-8f38de784908-istio-podinfo\") pod \"e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:18.541281 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.541248 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa764a03-d0fd-449b-b17b-8f38de784908-istio-token\") pod \"e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:18.541448 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.541427 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtvf6\" (UniqueName: \"kubernetes.io/projected/fa764a03-d0fd-449b-b17b-8f38de784908-kube-api-access-qtvf6\") pod \"e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:18.640580 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.640442 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:18.786261 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.786234 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm"] Jul 08 18:07:18.788195 ip-10-0-130-38 kubenswrapper[2552]: W0708 18:07:18.788160 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa764a03_d0fd_449b_b17b_8f38de784908.slice/crio-56900d94cb46f8194957259e6433492951ca602d8e76849061d7bbc8630117c1 WatchSource:0}: Error finding container 56900d94cb46f8194957259e6433492951ca602d8e76849061d7bbc8630117c1: Status 404 returned error can't find the container with id 56900d94cb46f8194957259e6433492951ca602d8e76849061d7bbc8630117c1 Jul 08 18:07:18.790257 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.790217 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:07:18.790362 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.790304 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:07:18.790362 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:18.790348 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:07:19.551885 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:19.551853 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" event={"ID":"fa764a03-d0fd-449b-b17b-8f38de784908","Type":"ContainerStarted","Data":"dd95e5c4f236628d3223319dfb19b9738b1b72cb9d88aa3eb97c61adef0a4342"} Jul 08 18:07:19.552045 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:19.551909 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" event={"ID":"fa764a03-d0fd-449b-b17b-8f38de784908","Type":"ContainerStarted","Data":"56900d94cb46f8194957259e6433492951ca602d8e76849061d7bbc8630117c1"} Jul 08 18:07:19.580906 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:19.580858 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" podStartSLOduration=1.5808430439999999 podStartE2EDuration="1.580843044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:07:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:07:19.578556936 +0000 UTC m=+2037.814949180" watchObservedRunningTime="2026-07-08 18:07:19.580843044 +0000 UTC m=+2037.817235360" Jul 08 18:07:19.641199 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:19.641164 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:19.646564 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:19.646524 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:19.794157 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:19.794079 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:19.857309 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:19.857201 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:20.558163 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:20.558124 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:20.559093 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:20.559071 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:21.615770 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:21.615694 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:21.714119 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:21.714082 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:21.813850 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:21.813818 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:22.348997 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:22.348954 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:22.475990 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:22.475920 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:26.050122 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:26.050090 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:26.804623 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:26.804585 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:26.903825 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:26.903796 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:27.263456 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:27.263424 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:33.694490 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:33.694457 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:33.797212 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:33.797124 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:34.128907 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:34.128819 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:34.490497 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:34.490448 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:34.566740 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:34.566698 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:36.332689 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:36.332649 2552 patch_prober.go:28] interesting pod/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": read tcp 10.132.0.2:47376->10.132.0.54:15021: read: connection reset by peer" start-of-body= Jul 08 18:07:36.333056 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:36.332731 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" podUID="fa764a03-d0fd-449b-b17b-8f38de784908" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": read tcp 10.132.0.2:47376->10.132.0.54:15021: read: connection reset by peer" Jul 08 18:07:36.650165 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:36.650073 2552 generic.go:356] "Generic (PLEG): container finished" podID="fa764a03-d0fd-449b-b17b-8f38de784908" containerID="dd95e5c4f236628d3223319dfb19b9738b1b72cb9d88aa3eb97c61adef0a4342" exitCode=0 Jul 08 18:07:36.650165 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:36.650132 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" event={"ID":"fa764a03-d0fd-449b-b17b-8f38de784908","Type":"ContainerDied","Data":"dd95e5c4f236628d3223319dfb19b9738b1b72cb9d88aa3eb97c61adef0a4342"} Jul 08 18:07:36.650497 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:36.650484 2552 scope.go:117] "RemoveContainer" containerID="dd95e5c4f236628d3223319dfb19b9738b1b72cb9d88aa3eb97c61adef0a4342" Jul 08 18:07:36.651485 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:36.651456 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:07:36.651558 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:36.651524 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:07:36.651599 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:36.651586 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:07:37.658709 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:37.658678 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" event={"ID":"fa764a03-d0fd-449b-b17b-8f38de784908","Type":"ContainerStarted","Data":"93f7bb08395d322c135c55fda6eeb7fb3096e926d201caaa8949c4c81d0a65c0"} Jul 08 18:07:38.641850 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:38.641819 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:38.642201 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:38.642177 2552 patch_prober.go:28] interesting pod/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 08 18:07:38.642364 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:38.642337 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" podUID="fa764a03-d0fd-449b-b17b-8f38de784908" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 08 18:07:39.641004 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:39.640956 2552 patch_prober.go:28] interesting pod/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 08 18:07:39.641497 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:39.641043 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" podUID="fa764a03-d0fd-449b-b17b-8f38de784908" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 08 18:07:40.641805 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:40.641764 2552 patch_prober.go:28] interesting pod/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 08 18:07:40.642391 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:40.642358 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" podUID="fa764a03-d0fd-449b-b17b-8f38de784908" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 08 18:07:41.572001 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:41.571971 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:41.641475 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:41.641441 2552 patch_prober.go:28] interesting pod/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 08 18:07:41.641772 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:41.641744 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" podUID="fa764a03-d0fd-449b-b17b-8f38de784908" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 08 18:07:41.756037 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:41.755997 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:41.991707 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:41.991673 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm"] Jul 08 18:07:41.991924 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:41.991896 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" podUID="fa764a03-d0fd-449b-b17b-8f38de784908" containerName="istio-proxy" containerID="cri-o://93f7bb08395d322c135c55fda6eeb7fb3096e926d201caaa8949c4c81d0a65c0" gracePeriod=30 Jul 08 18:07:42.021657 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:42.021626 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:43.434395 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:43.434275 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:44.681120 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:44.681082 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:47.243624 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.243598 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:47.313059 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.312971 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa764a03-d0fd-449b-b17b-8f38de784908-istio-envoy\") pod \"fa764a03-d0fd-449b-b17b-8f38de784908\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " Jul 08 18:07:47.313059 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.313044 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa764a03-d0fd-449b-b17b-8f38de784908-credential-socket\") pod \"fa764a03-d0fd-449b-b17b-8f38de784908\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " Jul 08 18:07:47.313284 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.313093 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa764a03-d0fd-449b-b17b-8f38de784908-istio-data\") pod \"fa764a03-d0fd-449b-b17b-8f38de784908\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " Jul 08 18:07:47.313284 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.313114 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa764a03-d0fd-449b-b17b-8f38de784908-workload-socket\") pod \"fa764a03-d0fd-449b-b17b-8f38de784908\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " Jul 08 18:07:47.313284 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.313149 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtvf6\" (UniqueName: \"kubernetes.io/projected/fa764a03-d0fd-449b-b17b-8f38de784908-kube-api-access-qtvf6\") pod \"fa764a03-d0fd-449b-b17b-8f38de784908\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " Jul 08 18:07:47.313284 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.313172 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa764a03-d0fd-449b-b17b-8f38de784908-istio-token\") pod \"fa764a03-d0fd-449b-b17b-8f38de784908\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " Jul 08 18:07:47.313284 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.313227 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa764a03-d0fd-449b-b17b-8f38de784908-istiod-ca-cert\") pod \"fa764a03-d0fd-449b-b17b-8f38de784908\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " Jul 08 18:07:47.313564 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.313343 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa764a03-d0fd-449b-b17b-8f38de784908-istio-podinfo\") pod \"fa764a03-d0fd-449b-b17b-8f38de784908\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " Jul 08 18:07:47.313564 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.313348 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa764a03-d0fd-449b-b17b-8f38de784908-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fa764a03-d0fd-449b-b17b-8f38de784908" (UID: "fa764a03-d0fd-449b-b17b-8f38de784908"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:07:47.313564 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.313481 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa764a03-d0fd-449b-b17b-8f38de784908-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fa764a03-d0fd-449b-b17b-8f38de784908" (UID: "fa764a03-d0fd-449b-b17b-8f38de784908"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:07:47.313744 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.313709 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa764a03-d0fd-449b-b17b-8f38de784908-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fa764a03-d0fd-449b-b17b-8f38de784908" (UID: "fa764a03-d0fd-449b-b17b-8f38de784908"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:07:47.313818 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.313776 2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa764a03-d0fd-449b-b17b-8f38de784908-credential-socket\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:07:47.313818 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.313800 2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fa764a03-d0fd-449b-b17b-8f38de784908-workload-socket\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:07:47.314380 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.314350 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa764a03-d0fd-449b-b17b-8f38de784908-istio-data" (OuterVolumeSpecName: "istio-data") pod "fa764a03-d0fd-449b-b17b-8f38de784908" (UID: "fa764a03-d0fd-449b-b17b-8f38de784908"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:07:47.315516 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.315478 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa764a03-d0fd-449b-b17b-8f38de784908-kube-api-access-qtvf6" (OuterVolumeSpecName: "kube-api-access-qtvf6") pod "fa764a03-d0fd-449b-b17b-8f38de784908" (UID: "fa764a03-d0fd-449b-b17b-8f38de784908"). InnerVolumeSpecName "kube-api-access-qtvf6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:07:47.315516 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.315499 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa764a03-d0fd-449b-b17b-8f38de784908-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fa764a03-d0fd-449b-b17b-8f38de784908" (UID: "fa764a03-d0fd-449b-b17b-8f38de784908"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:07:47.315708 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.315520 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fa764a03-d0fd-449b-b17b-8f38de784908-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fa764a03-d0fd-449b-b17b-8f38de784908" (UID: "fa764a03-d0fd-449b-b17b-8f38de784908"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 18:07:47.315708 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.315562 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa764a03-d0fd-449b-b17b-8f38de784908-istio-token" (OuterVolumeSpecName: "istio-token") pod "fa764a03-d0fd-449b-b17b-8f38de784908" (UID: "fa764a03-d0fd-449b-b17b-8f38de784908"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:07:47.414402 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.414373 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa764a03-d0fd-449b-b17b-8f38de784908-workload-certs\") pod \"fa764a03-d0fd-449b-b17b-8f38de784908\" (UID: \"fa764a03-d0fd-449b-b17b-8f38de784908\") " Jul 08 18:07:47.414639 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.414614 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa764a03-d0fd-449b-b17b-8f38de784908-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fa764a03-d0fd-449b-b17b-8f38de784908" (UID: "fa764a03-d0fd-449b-b17b-8f38de784908"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:07:47.414723 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.414704 2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fa764a03-d0fd-449b-b17b-8f38de784908-istio-token\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:07:47.414788 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.414725 2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fa764a03-d0fd-449b-b17b-8f38de784908-istiod-ca-cert\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:07:47.414788 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.414738 2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fa764a03-d0fd-449b-b17b-8f38de784908-istio-podinfo\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:07:47.414788 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.414751 2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fa764a03-d0fd-449b-b17b-8f38de784908-istio-envoy\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:07:47.414788 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.414764 2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fa764a03-d0fd-449b-b17b-8f38de784908-istio-data\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:07:47.414788 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.414777 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtvf6\" (UniqueName: \"kubernetes.io/projected/fa764a03-d0fd-449b-b17b-8f38de784908-kube-api-access-qtvf6\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:07:47.516004 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.515968 2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fa764a03-d0fd-449b-b17b-8f38de784908-workload-certs\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:07:47.712347 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.712319 2552 generic.go:356] "Generic (PLEG): container finished" podID="fa764a03-d0fd-449b-b17b-8f38de784908" containerID="93f7bb08395d322c135c55fda6eeb7fb3096e926d201caaa8949c4c81d0a65c0" exitCode=0 Jul 08 18:07:47.712520 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.712369 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" Jul 08 18:07:47.712520 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.712407 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" event={"ID":"fa764a03-d0fd-449b-b17b-8f38de784908","Type":"ContainerDied","Data":"93f7bb08395d322c135c55fda6eeb7fb3096e926d201caaa8949c4c81d0a65c0"} Jul 08 18:07:47.712520 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.712465 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm" event={"ID":"fa764a03-d0fd-449b-b17b-8f38de784908","Type":"ContainerDied","Data":"56900d94cb46f8194957259e6433492951ca602d8e76849061d7bbc8630117c1"} Jul 08 18:07:47.712520 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.712498 2552 scope.go:117] "RemoveContainer" containerID="93f7bb08395d322c135c55fda6eeb7fb3096e926d201caaa8949c4c81d0a65c0" Jul 08 18:07:47.722317 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.722296 2552 scope.go:117] "RemoveContainer" containerID="dd95e5c4f236628d3223319dfb19b9738b1b72cb9d88aa3eb97c61adef0a4342" Jul 08 18:07:47.732306 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.732279 2552 scope.go:117] "RemoveContainer" containerID="93f7bb08395d322c135c55fda6eeb7fb3096e926d201caaa8949c4c81d0a65c0" Jul 08 18:07:47.732605 ip-10-0-130-38 kubenswrapper[2552]: E0708 18:07:47.732559 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93f7bb08395d322c135c55fda6eeb7fb3096e926d201caaa8949c4c81d0a65c0\": container with ID starting with 93f7bb08395d322c135c55fda6eeb7fb3096e926d201caaa8949c4c81d0a65c0 not found: ID does not exist" containerID="93f7bb08395d322c135c55fda6eeb7fb3096e926d201caaa8949c4c81d0a65c0" Jul 08 18:07:47.732605 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.732593 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93f7bb08395d322c135c55fda6eeb7fb3096e926d201caaa8949c4c81d0a65c0"} err="failed to get container status \"93f7bb08395d322c135c55fda6eeb7fb3096e926d201caaa8949c4c81d0a65c0\": rpc error: code = NotFound desc = could not find container \"93f7bb08395d322c135c55fda6eeb7fb3096e926d201caaa8949c4c81d0a65c0\": container with ID starting with 93f7bb08395d322c135c55fda6eeb7fb3096e926d201caaa8949c4c81d0a65c0 not found: ID does not exist" Jul 08 18:07:47.732760 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.732609 2552 scope.go:117] "RemoveContainer" containerID="dd95e5c4f236628d3223319dfb19b9738b1b72cb9d88aa3eb97c61adef0a4342" Jul 08 18:07:47.732875 ip-10-0-130-38 kubenswrapper[2552]: E0708 18:07:47.732858 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd95e5c4f236628d3223319dfb19b9738b1b72cb9d88aa3eb97c61adef0a4342\": container with ID starting with dd95e5c4f236628d3223319dfb19b9738b1b72cb9d88aa3eb97c61adef0a4342 not found: ID does not exist" containerID="dd95e5c4f236628d3223319dfb19b9738b1b72cb9d88aa3eb97c61adef0a4342" Jul 08 18:07:47.732915 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.732881 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd95e5c4f236628d3223319dfb19b9738b1b72cb9d88aa3eb97c61adef0a4342"} err="failed to get container status \"dd95e5c4f236628d3223319dfb19b9738b1b72cb9d88aa3eb97c61adef0a4342\": rpc error: code = NotFound desc = could not find container \"dd95e5c4f236628d3223319dfb19b9738b1b72cb9d88aa3eb97c61adef0a4342\": container with ID starting with dd95e5c4f236628d3223319dfb19b9738b1b72cb9d88aa3eb97c61adef0a4342 not found: ID does not exist" Jul 08 18:07:47.739138 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.739116 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm"] Jul 08 18:07:47.743815 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:47.743796 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-a1cf05a8-openshift-default-8488ff9775-zqvmm"] Jul 08 18:07:48.307488 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:48.307456 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa764a03-d0fd-449b-b17b-8f38de784908" path="/var/lib/kubelet/pods/fa764a03-d0fd-449b-b17b-8f38de784908/volumes" Jul 08 18:07:49.468220 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:49.468178 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:49.599507 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:49.599461 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:49.702817 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:49.702776 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:49.832481 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:49.832399 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:50.938431 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:50.938378 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:51.039074 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:51.039037 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:55.992994 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:55.992959 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:07:56.142083 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:07:56.142055 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:08:02.842351 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:02.842315 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:08:03.134669 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.134586 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q"] Jul 08 18:08:03.135118 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.135097 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa764a03-d0fd-449b-b17b-8f38de784908" containerName="istio-proxy" Jul 08 18:08:03.135118 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.135119 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa764a03-d0fd-449b-b17b-8f38de784908" containerName="istio-proxy" Jul 08 18:08:03.135327 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.135243 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa764a03-d0fd-449b-b17b-8f38de784908" containerName="istio-proxy" Jul 08 18:08:03.135327 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.135257 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa764a03-d0fd-449b-b17b-8f38de784908" containerName="istio-proxy" Jul 08 18:08:03.138170 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.138149 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:03.141092 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.141064 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-253d53e7-openshift-default-dockercfg-f2fkb\"" Jul 08 18:08:03.157755 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.157724 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q"] Jul 08 18:08:03.165443 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.165394 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:08:03.262567 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.262501 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abe66bd8-665c-451e-8b85-850da4aa665a-istio-data\") pod \"e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:03.262739 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.262610 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abe66bd8-665c-451e-8b85-850da4aa665a-istio-token\") pod \"e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:03.262739 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.262647 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe66bd8-665c-451e-8b85-850da4aa665a-credential-socket\") pod \"e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:03.262739 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.262696 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj2xn\" (UniqueName: \"kubernetes.io/projected/abe66bd8-665c-451e-8b85-850da4aa665a-kube-api-access-pj2xn\") pod \"e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:03.262739 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.262728 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe66bd8-665c-451e-8b85-850da4aa665a-workload-socket\") pod \"e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:03.262968 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.262752 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abe66bd8-665c-451e-8b85-850da4aa665a-istiod-ca-cert\") pod \"e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:03.262968 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.262840 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abe66bd8-665c-451e-8b85-850da4aa665a-istio-envoy\") pod \"e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:03.262968 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.262919 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abe66bd8-665c-451e-8b85-850da4aa665a-istio-podinfo\") pod \"e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:03.262968 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.262955 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abe66bd8-665c-451e-8b85-850da4aa665a-workload-certs\") pod \"e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:03.363777 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.363739 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abe66bd8-665c-451e-8b85-850da4aa665a-istio-data\") pod \"e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:03.364817 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.364792 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abe66bd8-665c-451e-8b85-850da4aa665a-istio-token\") pod \"e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:03.365329 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.364670 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abe66bd8-665c-451e-8b85-850da4aa665a-istio-data\") pod \"e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:03.365499 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.365315 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe66bd8-665c-451e-8b85-850da4aa665a-credential-socket\") pod \"e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:03.365691 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.365671 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj2xn\" (UniqueName: \"kubernetes.io/projected/abe66bd8-665c-451e-8b85-850da4aa665a-kube-api-access-pj2xn\") pod \"e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:03.366045 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.366029 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe66bd8-665c-451e-8b85-850da4aa665a-workload-socket\") pod \"e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:03.366171 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.366156 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abe66bd8-665c-451e-8b85-850da4aa665a-istiod-ca-cert\") pod \"e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:03.366295 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.366271 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe66bd8-665c-451e-8b85-850da4aa665a-workload-socket\") pod \"e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:03.366359 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.366272 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abe66bd8-665c-451e-8b85-850da4aa665a-istio-envoy\") pod \"e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:03.366412 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.366371 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abe66bd8-665c-451e-8b85-850da4aa665a-istio-podinfo\") pod \"e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:03.366412 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.366401 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abe66bd8-665c-451e-8b85-850da4aa665a-workload-certs\") pod \"e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:03.366721 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.366700 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abe66bd8-665c-451e-8b85-850da4aa665a-workload-certs\") pod \"e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:03.367050 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.365532 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe66bd8-665c-451e-8b85-850da4aa665a-credential-socket\") pod \"e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:03.367485 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.367462 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abe66bd8-665c-451e-8b85-850da4aa665a-istiod-ca-cert\") pod \"e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:03.370773 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.370750 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abe66bd8-665c-451e-8b85-850da4aa665a-istio-envoy\") pod \"e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:03.375409 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.375051 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abe66bd8-665c-451e-8b85-850da4aa665a-istio-token\") pod \"e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:03.375409 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.375370 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj2xn\" (UniqueName: \"kubernetes.io/projected/abe66bd8-665c-451e-8b85-850da4aa665a-kube-api-access-pj2xn\") pod \"e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:03.378258 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.378232 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abe66bd8-665c-451e-8b85-850da4aa665a-istio-podinfo\") pod \"e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:03.449466 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.449428 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:03.608067 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.608038 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q"] Jul 08 18:08:03.610256 ip-10-0-130-38 kubenswrapper[2552]: W0708 18:08:03.610229 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabe66bd8_665c_451e_8b85_850da4aa665a.slice/crio-fd2de2f827e03f1009e191c00ce2fb5202426c090aaebdcab44c3c9712ec0dd3 WatchSource:0}: Error finding container fd2de2f827e03f1009e191c00ce2fb5202426c090aaebdcab44c3c9712ec0dd3: Status 404 returned error can't find the container with id fd2de2f827e03f1009e191c00ce2fb5202426c090aaebdcab44c3c9712ec0dd3 Jul 08 18:08:03.612417 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.612385 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:08:03.612495 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.612447 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:08:03.612568 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.612492 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:08:03.771863 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.771783 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:08:03.802440 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.802398 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" event={"ID":"abe66bd8-665c-451e-8b85-850da4aa665a","Type":"ContainerStarted","Data":"deea561c350be2916ece1bf814e78d2cd3707115443060c2588142d84b781b16"} Jul 08 18:08:03.802643 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.802468 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" event={"ID":"abe66bd8-665c-451e-8b85-850da4aa665a","Type":"ContainerStarted","Data":"fd2de2f827e03f1009e191c00ce2fb5202426c090aaebdcab44c3c9712ec0dd3"} Jul 08 18:08:03.834844 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:03.834793 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" podStartSLOduration=0.834774856 podStartE2EDuration="834.774856ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:08:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:08:03.832401314 +0000 UTC m=+2082.068793561" watchObservedRunningTime="2026-07-08 18:08:03.834774856 +0000 UTC m=+2082.071167103" Jul 08 18:08:04.450483 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:04.450445 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:04.455717 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:04.455691 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:04.811201 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:04.811116 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:04.812048 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:04.812028 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:05.774452 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:05.774418 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:08:05.862940 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:05.862900 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:08:05.945982 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:05.945940 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:08:06.043262 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:06.043174 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:08:06.309750 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:06.309646 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:08:06.409661 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:06.409626 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:08:10.303284 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:10.303237 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:08:13.933371 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:13.933340 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:08:16.885475 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:16.885446 2552 generic.go:356] "Generic (PLEG): container finished" podID="abe66bd8-665c-451e-8b85-850da4aa665a" containerID="deea561c350be2916ece1bf814e78d2cd3707115443060c2588142d84b781b16" exitCode=0 Jul 08 18:08:16.885845 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:16.885525 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" event={"ID":"abe66bd8-665c-451e-8b85-850da4aa665a","Type":"ContainerDied","Data":"deea561c350be2916ece1bf814e78d2cd3707115443060c2588142d84b781b16"} Jul 08 18:08:16.885951 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:16.885936 2552 scope.go:117] "RemoveContainer" containerID="deea561c350be2916ece1bf814e78d2cd3707115443060c2588142d84b781b16" Jul 08 18:08:16.887047 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:16.887013 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:08:16.887157 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:16.887098 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:08:16.887157 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:16.887146 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:08:17.893184 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:17.893153 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" event={"ID":"abe66bd8-665c-451e-8b85-850da4aa665a","Type":"ContainerStarted","Data":"04ccf92be3eae41675c571fa5453ce1765056d3a5a06925f0e9faf76788c164a"} Jul 08 18:08:18.449919 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:18.449870 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:18.451005 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:18.450980 2552 patch_prober.go:28] interesting pod/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 08 18:08:18.451106 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:18.451032 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" podUID="abe66bd8-665c-451e-8b85-850da4aa665a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 08 18:08:19.450354 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:19.450312 2552 patch_prober.go:28] interesting pod/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 08 18:08:19.450797 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:19.450386 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" podUID="abe66bd8-665c-451e-8b85-850da4aa665a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 08 18:08:19.811805 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:19.811702 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:20.450559 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:20.450496 2552 patch_prober.go:28] interesting pod/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 08 18:08:20.450951 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:20.450578 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" podUID="abe66bd8-665c-451e-8b85-850da4aa665a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 08 18:08:21.450566 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:21.450506 2552 patch_prober.go:28] interesting pod/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 08 18:08:21.450952 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:21.450581 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" podUID="abe66bd8-665c-451e-8b85-850da4aa665a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 08 18:08:22.388458 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:22.388431 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-mnhqg_058a4314-4829-4b3d-a275-477b305bcf91/console-operator/1.log" Jul 08 18:08:22.390836 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:22.390813 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-mnhqg_058a4314-4829-4b3d-a275-477b305bcf91/console-operator/1.log" Jul 08 18:08:22.453774 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:22.453746 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:22.454785 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:22.454767 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:08:32.526307 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:32.526270 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:08:32.885021 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:32.884930 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:08:38.681114 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:38.681061 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:08:44.479958 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:44.479921 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:08:50.376255 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:08:50.376223 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:09:20.244175 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:20.244082 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:09:21.546532 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:21.546493 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:09:27.355884 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:27.355851 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:09:27.432830 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:27.432789 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:09:27.771791 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:27.771759 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q"] Jul 08 18:09:27.783252 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:27.783219 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:09:28.268555 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:28.268509 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" podUID="abe66bd8-665c-451e-8b85-850da4aa665a" containerName="istio-proxy" containerID="cri-o://04ccf92be3eae41675c571fa5453ce1765056d3a5a06925f0e9faf76788c164a" gracePeriod=30 Jul 08 18:09:29.028782 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:29.028743 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:09:29.117848 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:29.117812 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:09:29.944711 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:29.944670 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:09:30.053080 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:30.053046 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:09:31.510486 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:31.510449 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:09:33.528564 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:33.528477 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:09:33.602079 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:33.602049 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abe66bd8-665c-451e-8b85-850da4aa665a-istio-envoy\") pod \"abe66bd8-665c-451e-8b85-850da4aa665a\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " Jul 08 18:09:33.602079 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:33.602082 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe66bd8-665c-451e-8b85-850da4aa665a-workload-socket\") pod \"abe66bd8-665c-451e-8b85-850da4aa665a\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " Jul 08 18:09:33.602302 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:33.602130 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe66bd8-665c-451e-8b85-850da4aa665a-credential-socket\") pod \"abe66bd8-665c-451e-8b85-850da4aa665a\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " Jul 08 18:09:33.602302 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:33.602156 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abe66bd8-665c-451e-8b85-850da4aa665a-istiod-ca-cert\") pod \"abe66bd8-665c-451e-8b85-850da4aa665a\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " Jul 08 18:09:33.602302 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:33.602200 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abe66bd8-665c-451e-8b85-850da4aa665a-istio-token\") pod \"abe66bd8-665c-451e-8b85-850da4aa665a\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " Jul 08 18:09:33.602302 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:33.602221 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abe66bd8-665c-451e-8b85-850da4aa665a-workload-certs\") pod \"abe66bd8-665c-451e-8b85-850da4aa665a\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " Jul 08 18:09:33.602302 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:33.602252 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abe66bd8-665c-451e-8b85-850da4aa665a-istio-data\") pod \"abe66bd8-665c-451e-8b85-850da4aa665a\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " Jul 08 18:09:33.602302 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:33.602276 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abe66bd8-665c-451e-8b85-850da4aa665a-istio-podinfo\") pod \"abe66bd8-665c-451e-8b85-850da4aa665a\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " Jul 08 18:09:33.602302 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:33.602303 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pj2xn\" (UniqueName: \"kubernetes.io/projected/abe66bd8-665c-451e-8b85-850da4aa665a-kube-api-access-pj2xn\") pod \"abe66bd8-665c-451e-8b85-850da4aa665a\" (UID: \"abe66bd8-665c-451e-8b85-850da4aa665a\") " Jul 08 18:09:33.602694 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:33.602419 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abe66bd8-665c-451e-8b85-850da4aa665a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "abe66bd8-665c-451e-8b85-850da4aa665a" (UID: "abe66bd8-665c-451e-8b85-850da4aa665a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:09:33.602694 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:33.602653 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abe66bd8-665c-451e-8b85-850da4aa665a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "abe66bd8-665c-451e-8b85-850da4aa665a" (UID: "abe66bd8-665c-451e-8b85-850da4aa665a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:09:33.602694 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:33.602671 2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe66bd8-665c-451e-8b85-850da4aa665a-workload-socket\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:09:33.602866 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:33.602686 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abe66bd8-665c-451e-8b85-850da4aa665a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "abe66bd8-665c-451e-8b85-850da4aa665a" (UID: "abe66bd8-665c-451e-8b85-850da4aa665a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:09:33.602866 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:33.602754 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abe66bd8-665c-451e-8b85-850da4aa665a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "abe66bd8-665c-451e-8b85-850da4aa665a" (UID: "abe66bd8-665c-451e-8b85-850da4aa665a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:09:33.603144 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:33.603119 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abe66bd8-665c-451e-8b85-850da4aa665a-istio-data" (OuterVolumeSpecName: "istio-data") pod "abe66bd8-665c-451e-8b85-850da4aa665a" (UID: "abe66bd8-665c-451e-8b85-850da4aa665a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:09:33.604622 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:33.604580 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/abe66bd8-665c-451e-8b85-850da4aa665a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "abe66bd8-665c-451e-8b85-850da4aa665a" (UID: "abe66bd8-665c-451e-8b85-850da4aa665a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 18:09:33.604731 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:33.604658 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abe66bd8-665c-451e-8b85-850da4aa665a-istio-token" (OuterVolumeSpecName: "istio-token") pod "abe66bd8-665c-451e-8b85-850da4aa665a" (UID: "abe66bd8-665c-451e-8b85-850da4aa665a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:09:33.604956 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:33.604934 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abe66bd8-665c-451e-8b85-850da4aa665a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "abe66bd8-665c-451e-8b85-850da4aa665a" (UID: "abe66bd8-665c-451e-8b85-850da4aa665a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:09:33.605040 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:33.604978 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abe66bd8-665c-451e-8b85-850da4aa665a-kube-api-access-pj2xn" (OuterVolumeSpecName: "kube-api-access-pj2xn") pod "abe66bd8-665c-451e-8b85-850da4aa665a" (UID: "abe66bd8-665c-451e-8b85-850da4aa665a"). InnerVolumeSpecName "kube-api-access-pj2xn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:09:33.704003 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:33.703971 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pj2xn\" (UniqueName: \"kubernetes.io/projected/abe66bd8-665c-451e-8b85-850da4aa665a-kube-api-access-pj2xn\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:09:33.704003 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:33.704000 2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abe66bd8-665c-451e-8b85-850da4aa665a-istio-envoy\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:09:33.704208 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:33.704012 2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abe66bd8-665c-451e-8b85-850da4aa665a-credential-socket\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:09:33.704208 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:33.704026 2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abe66bd8-665c-451e-8b85-850da4aa665a-istiod-ca-cert\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:09:33.704208 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:33.704037 2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abe66bd8-665c-451e-8b85-850da4aa665a-istio-token\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:09:33.704208 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:33.704047 2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abe66bd8-665c-451e-8b85-850da4aa665a-workload-certs\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:09:33.704208 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:33.704058 2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abe66bd8-665c-451e-8b85-850da4aa665a-istio-data\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:09:33.704208 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:33.704070 2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abe66bd8-665c-451e-8b85-850da4aa665a-istio-podinfo\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:09:34.303067 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:34.303037 2552 generic.go:356] "Generic (PLEG): container finished" podID="abe66bd8-665c-451e-8b85-850da4aa665a" containerID="04ccf92be3eae41675c571fa5453ce1765056d3a5a06925f0e9faf76788c164a" exitCode=0 Jul 08 18:09:34.303247 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:34.303145 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" Jul 08 18:09:34.308352 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:34.308321 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" event={"ID":"abe66bd8-665c-451e-8b85-850da4aa665a","Type":"ContainerDied","Data":"04ccf92be3eae41675c571fa5453ce1765056d3a5a06925f0e9faf76788c164a"} Jul 08 18:09:34.308490 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:34.308384 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q" event={"ID":"abe66bd8-665c-451e-8b85-850da4aa665a","Type":"ContainerDied","Data":"fd2de2f827e03f1009e191c00ce2fb5202426c090aaebdcab44c3c9712ec0dd3"} Jul 08 18:09:34.308490 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:34.308417 2552 scope.go:117] "RemoveContainer" containerID="04ccf92be3eae41675c571fa5453ce1765056d3a5a06925f0e9faf76788c164a" Jul 08 18:09:34.320908 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:34.320890 2552 scope.go:117] "RemoveContainer" containerID="deea561c350be2916ece1bf814e78d2cd3707115443060c2588142d84b781b16" Jul 08 18:09:34.330686 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:34.330666 2552 scope.go:117] "RemoveContainer" containerID="04ccf92be3eae41675c571fa5453ce1765056d3a5a06925f0e9faf76788c164a" Jul 08 18:09:34.330863 ip-10-0-130-38 kubenswrapper[2552]: E0708 18:09:34.330828 2552 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabe66bd8_665c_451e_8b85_850da4aa665a.slice\": RecentStats: unable to find data in memory cache]" Jul 08 18:09:34.330985 ip-10-0-130-38 kubenswrapper[2552]: E0708 18:09:34.330957 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04ccf92be3eae41675c571fa5453ce1765056d3a5a06925f0e9faf76788c164a\": container with ID starting with 04ccf92be3eae41675c571fa5453ce1765056d3a5a06925f0e9faf76788c164a not found: ID does not exist" containerID="04ccf92be3eae41675c571fa5453ce1765056d3a5a06925f0e9faf76788c164a" Jul 08 18:09:34.331112 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:34.330996 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04ccf92be3eae41675c571fa5453ce1765056d3a5a06925f0e9faf76788c164a"} err="failed to get container status \"04ccf92be3eae41675c571fa5453ce1765056d3a5a06925f0e9faf76788c164a\": rpc error: code = NotFound desc = could not find container \"04ccf92be3eae41675c571fa5453ce1765056d3a5a06925f0e9faf76788c164a\": container with ID starting with 04ccf92be3eae41675c571fa5453ce1765056d3a5a06925f0e9faf76788c164a not found: ID does not exist" Jul 08 18:09:34.331112 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:34.331015 2552 scope.go:117] "RemoveContainer" containerID="deea561c350be2916ece1bf814e78d2cd3707115443060c2588142d84b781b16" Jul 08 18:09:34.331297 ip-10-0-130-38 kubenswrapper[2552]: E0708 18:09:34.331278 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"deea561c350be2916ece1bf814e78d2cd3707115443060c2588142d84b781b16\": container with ID starting with deea561c350be2916ece1bf814e78d2cd3707115443060c2588142d84b781b16 not found: ID does not exist" containerID="deea561c350be2916ece1bf814e78d2cd3707115443060c2588142d84b781b16" Jul 08 18:09:34.331351 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:34.331304 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"deea561c350be2916ece1bf814e78d2cd3707115443060c2588142d84b781b16"} err="failed to get container status \"deea561c350be2916ece1bf814e78d2cd3707115443060c2588142d84b781b16\": rpc error: code = NotFound desc = could not find container \"deea561c350be2916ece1bf814e78d2cd3707115443060c2588142d84b781b16\": container with ID starting with deea561c350be2916ece1bf814e78d2cd3707115443060c2588142d84b781b16 not found: ID does not exist" Jul 08 18:09:34.336591 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:34.335601 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q"] Jul 08 18:09:34.339710 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:34.339686 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-253d53e7-openshift-default-7c6f9b9ccf-tsv7q"] Jul 08 18:09:36.306722 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:36.306684 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abe66bd8-665c-451e-8b85-850da4aa665a" path="/var/lib/kubelet/pods/abe66bd8-665c-451e-8b85-850da4aa665a/volumes" Jul 08 18:09:38.376021 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:38.375988 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:09:39.463411 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:39.463375 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:09:39.570282 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:39.570247 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:09:45.273532 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:45.273501 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:09:45.342458 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:45.342429 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:09:45.480845 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:45.480813 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:09:45.569743 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:45.569607 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:09:56.061503 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:56.061467 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:09:56.418928 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:09:56.418845 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:10:04.203103 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:04.203063 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:10:17.504746 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:17.504714 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:10:24.223451 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:24.223415 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:10:24.323437 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:24.323406 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:10:24.608236 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:24.608153 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:10:24.963511 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:24.963478 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9"] Jul 08 18:10:24.964006 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:24.963987 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abe66bd8-665c-451e-8b85-850da4aa665a" containerName="istio-proxy" Jul 08 18:10:24.964006 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:24.964008 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="abe66bd8-665c-451e-8b85-850da4aa665a" containerName="istio-proxy" Jul 08 18:10:24.964128 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:24.964024 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abe66bd8-665c-451e-8b85-850da4aa665a" containerName="istio-proxy" Jul 08 18:10:24.964128 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:24.964029 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="abe66bd8-665c-451e-8b85-850da4aa665a" containerName="istio-proxy" Jul 08 18:10:24.964128 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:24.964039 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa764a03-d0fd-449b-b17b-8f38de784908" containerName="istio-proxy" Jul 08 18:10:24.964128 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:24.964044 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa764a03-d0fd-449b-b17b-8f38de784908" containerName="istio-proxy" Jul 08 18:10:24.964128 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:24.964113 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="abe66bd8-665c-451e-8b85-850da4aa665a" containerName="istio-proxy" Jul 08 18:10:24.964128 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:24.964120 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="abe66bd8-665c-451e-8b85-850da4aa665a" containerName="istio-proxy" Jul 08 18:10:24.968479 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:24.968458 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:24.972007 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:24.971985 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-975810-openshift-default-dockercfg-2hk8c\"" Jul 08 18:10:24.991253 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:24.991231 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9"] Jul 08 18:10:25.000907 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.000882 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:10:25.065172 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.065143 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa5e765a-f130-491b-b046-43723d04319e-credential-socket\") pod \"e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:25.065344 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.065176 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa5e765a-f130-491b-b046-43723d04319e-workload-socket\") pod \"e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:25.065344 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.065201 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa5e765a-f130-491b-b046-43723d04319e-istio-podinfo\") pod \"e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:25.065344 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.065285 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn46r\" (UniqueName: \"kubernetes.io/projected/aa5e765a-f130-491b-b046-43723d04319e-kube-api-access-rn46r\") pod \"e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:25.065466 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.065343 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa5e765a-f130-491b-b046-43723d04319e-istio-token\") pod \"e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:25.065466 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.065385 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa5e765a-f130-491b-b046-43723d04319e-istio-envoy\") pod \"e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:25.065466 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.065430 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa5e765a-f130-491b-b046-43723d04319e-istiod-ca-cert\") pod \"e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:25.065466 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.065458 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa5e765a-f130-491b-b046-43723d04319e-workload-certs\") pod \"e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:25.065627 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.065473 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa5e765a-f130-491b-b046-43723d04319e-istio-data\") pod \"e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:25.166760 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.166729 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa5e765a-f130-491b-b046-43723d04319e-istio-envoy\") pod \"e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:25.166964 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.166773 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa5e765a-f130-491b-b046-43723d04319e-istiod-ca-cert\") pod \"e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:25.166964 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.166794 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa5e765a-f130-491b-b046-43723d04319e-workload-certs\") pod \"e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:25.166964 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.166818 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa5e765a-f130-491b-b046-43723d04319e-istio-data\") pod \"e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:25.166964 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.166950 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa5e765a-f130-491b-b046-43723d04319e-credential-socket\") pod \"e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:25.167172 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.166994 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa5e765a-f130-491b-b046-43723d04319e-workload-socket\") pod \"e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:25.167172 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.167033 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa5e765a-f130-491b-b046-43723d04319e-istio-podinfo\") pod \"e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:25.167172 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.167085 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn46r\" (UniqueName: \"kubernetes.io/projected/aa5e765a-f130-491b-b046-43723d04319e-kube-api-access-rn46r\") pod \"e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:25.167172 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.167157 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa5e765a-f130-491b-b046-43723d04319e-istio-token\") pod \"e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:25.167357 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.167283 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa5e765a-f130-491b-b046-43723d04319e-istio-data\") pod \"e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:25.167357 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.167340 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa5e765a-f130-491b-b046-43723d04319e-workload-certs\") pod \"e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:25.167441 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.167373 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa5e765a-f130-491b-b046-43723d04319e-workload-socket\") pod \"e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:25.167441 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.167393 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa5e765a-f130-491b-b046-43723d04319e-credential-socket\") pod \"e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:25.167626 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.167608 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa5e765a-f130-491b-b046-43723d04319e-istiod-ca-cert\") pod \"e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:25.169386 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.169362 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa5e765a-f130-491b-b046-43723d04319e-istio-envoy\") pod \"e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:25.169751 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.169732 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa5e765a-f130-491b-b046-43723d04319e-istio-podinfo\") pod \"e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:25.179804 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.179775 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn46r\" (UniqueName: \"kubernetes.io/projected/aa5e765a-f130-491b-b046-43723d04319e-kube-api-access-rn46r\") pod \"e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:25.179915 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.179800 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa5e765a-f130-491b-b046-43723d04319e-istio-token\") pod \"e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:25.278660 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.278583 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:25.354158 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.354125 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:10:25.434758 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.434730 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9"] Jul 08 18:10:25.437488 ip-10-0-130-38 kubenswrapper[2552]: W0708 18:10:25.437455 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa5e765a_f130_491b_b046_43723d04319e.slice/crio-368af8419ef71698cc6cbc6f3b47633414e9356cf3c27196fd58aeadd1fe264f WatchSource:0}: Error finding container 368af8419ef71698cc6cbc6f3b47633414e9356cf3c27196fd58aeadd1fe264f: Status 404 returned error can't find the container with id 368af8419ef71698cc6cbc6f3b47633414e9356cf3c27196fd58aeadd1fe264f Jul 08 18:10:25.439651 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.439619 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:10:25.439736 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.439682 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:10:25.439736 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.439709 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:10:25.560986 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.560896 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" event={"ID":"aa5e765a-f130-491b-b046-43723d04319e","Type":"ContainerStarted","Data":"25cb73e0444cc2a2aed18c4aebcf99ee8e8c77391759a7e3dd2c2939fc6e3b76"} Jul 08 18:10:25.560986 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.560951 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" event={"ID":"aa5e765a-f130-491b-b046-43723d04319e","Type":"ContainerStarted","Data":"368af8419ef71698cc6cbc6f3b47633414e9356cf3c27196fd58aeadd1fe264f"} Jul 08 18:10:25.600356 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:25.600284 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" podStartSLOduration=1.600266915 podStartE2EDuration="1.600266915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:10:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:10:25.59878153 +0000 UTC m=+2223.835173785" watchObservedRunningTime="2026-07-08 18:10:25.600266915 +0000 UTC m=+2223.836659168" Jul 08 18:10:26.279445 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:26.279400 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:26.284872 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:26.284847 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:26.566024 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:26.565938 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:26.566858 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:26.566834 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:27.672505 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:27.672473 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:10:27.855900 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:27.855866 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:10:27.953438 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:27.953408 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:10:28.404213 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:28.404179 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:10:28.504960 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:28.504925 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:10:32.275391 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:32.275362 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:10:32.588571 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:32.588465 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:10:32.911034 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:32.910954 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch"] Jul 08 18:10:32.914619 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:32.914601 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:32.917157 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:32.917133 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-3be673-openshift-default-dockercfg-j8bzh\"" Jul 08 18:10:32.935135 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:32.935100 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch"] Jul 08 18:10:32.951772 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:32.951744 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:10:33.047069 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.047035 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-credential-socket\") pod \"e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:33.047291 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.047208 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-workload-socket\") pod \"e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:33.047365 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.047305 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-istiod-ca-cert\") pod \"e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:33.047365 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.047357 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-workload-certs\") pod \"e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:33.047471 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.047405 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-istio-podinfo\") pod \"e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:33.047471 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.047436 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7pk6\" (UniqueName: \"kubernetes.io/projected/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-kube-api-access-r7pk6\") pod \"e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:33.047616 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.047556 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-istio-token\") pod \"e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:33.047616 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.047588 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-istio-envoy\") pod \"e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:33.047726 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.047620 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-istio-data\") pod \"e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:33.148839 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.148796 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-credential-socket\") pod \"e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:33.148839 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.148841 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-workload-socket\") pod \"e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:33.149104 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.148882 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-istiod-ca-cert\") pod \"e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:33.149104 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.148914 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-workload-certs\") pod \"e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:33.149104 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.148940 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-istio-podinfo\") pod \"e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:33.149104 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.148967 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7pk6\" (UniqueName: \"kubernetes.io/projected/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-kube-api-access-r7pk6\") pod \"e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:33.149104 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.149009 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-istio-token\") pod \"e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:33.149104 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.149026 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-istio-envoy\") pod \"e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:33.149104 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.149048 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-istio-data\") pod \"e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:33.149469 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.149315 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-workload-socket\") pod \"e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:33.149469 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.149384 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-workload-certs\") pod \"e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:33.149682 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.149660 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-istio-data\") pod \"e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:33.149751 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.149695 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-istiod-ca-cert\") pod \"e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:33.149964 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.149941 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-credential-socket\") pod \"e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:33.151799 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.151780 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-istio-envoy\") pod \"e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:33.151955 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.151938 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-istio-podinfo\") pod \"e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:33.158462 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.158437 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-istio-token\") pod \"e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:33.158604 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.158440 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7pk6\" (UniqueName: \"kubernetes.io/projected/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-kube-api-access-r7pk6\") pod \"e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:33.234600 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.234564 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:33.418678 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.418650 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch"] Jul 08 18:10:33.419980 ip-10-0-130-38 kubenswrapper[2552]: W0708 18:10:33.419952 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46fb3b1e_4c6e_4bc5_9429_f3df0951dcbd.slice/crio-2e84ef4858b70c816e5ca58a3c9f62a62c05015446b8b74d0aa483a58198d2ab WatchSource:0}: Error finding container 2e84ef4858b70c816e5ca58a3c9f62a62c05015446b8b74d0aa483a58198d2ab: Status 404 returned error can't find the container with id 2e84ef4858b70c816e5ca58a3c9f62a62c05015446b8b74d0aa483a58198d2ab Jul 08 18:10:33.447702 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.445377 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:10:33.447702 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.445471 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:10:33.447702 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.445515 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:10:33.583594 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.583516 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:10:33.605459 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.605430 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" event={"ID":"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd","Type":"ContainerStarted","Data":"7a211d315a52d123c8fcc361778edf7fcba0fbf8c5c3839fc05290a131d77028"} Jul 08 18:10:33.605658 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.605489 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" event={"ID":"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd","Type":"ContainerStarted","Data":"2e84ef4858b70c816e5ca58a3c9f62a62c05015446b8b74d0aa483a58198d2ab"} Jul 08 18:10:33.632227 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:33.632161 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" podStartSLOduration=1.6321376650000001 podStartE2EDuration="1.632137665s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:10:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:10:33.627834793 +0000 UTC m=+2231.864227061" watchObservedRunningTime="2026-07-08 18:10:33.632137665 +0000 UTC m=+2231.868529919" Jul 08 18:10:34.235600 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:34.235564 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:34.247331 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:34.247299 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:34.610637 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:34.610528 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:34.611422 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:34.611404 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:35.684983 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:35.684949 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:10:35.774570 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:35.774506 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:10:35.857343 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:35.857311 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:10:36.059402 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:36.059367 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:10:36.359327 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:36.359253 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:10:36.564299 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:36.564267 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:10:39.638932 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:39.638896 2552 generic.go:356] "Generic (PLEG): container finished" podID="aa5e765a-f130-491b-b046-43723d04319e" containerID="25cb73e0444cc2a2aed18c4aebcf99ee8e8c77391759a7e3dd2c2939fc6e3b76" exitCode=0 Jul 08 18:10:39.639449 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:39.638977 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" event={"ID":"aa5e765a-f130-491b-b046-43723d04319e","Type":"ContainerDied","Data":"25cb73e0444cc2a2aed18c4aebcf99ee8e8c77391759a7e3dd2c2939fc6e3b76"} Jul 08 18:10:39.639525 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:39.639506 2552 scope.go:117] "RemoveContainer" containerID="25cb73e0444cc2a2aed18c4aebcf99ee8e8c77391759a7e3dd2c2939fc6e3b76" Jul 08 18:10:39.640595 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:39.640565 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:10:39.640702 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:39.640649 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:10:39.640765 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:39.640700 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:10:40.135463 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:40.135430 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:10:40.652839 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:40.652799 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" event={"ID":"aa5e765a-f130-491b-b046-43723d04319e","Type":"ContainerStarted","Data":"16e96d13706c49f8b389962ce36c33614bdf326d0c6f768630f5506a81fa7531"} Jul 08 18:10:41.279467 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:41.279438 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:41.280684 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:41.280659 2552 patch_prober.go:28] interesting pod/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 08 18:10:41.280826 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:41.280707 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" podUID="aa5e765a-f130-491b-b046-43723d04319e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 08 18:10:41.566644 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:41.566495 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:42.279046 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:42.279009 2552 patch_prober.go:28] interesting pod/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 08 18:10:42.279445 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:42.279071 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" podUID="aa5e765a-f130-491b-b046-43723d04319e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 08 18:10:43.279997 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:43.279897 2552 patch_prober.go:28] interesting pod/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 08 18:10:43.279997 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:43.279958 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" podUID="aa5e765a-f130-491b-b046-43723d04319e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 08 18:10:44.279329 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:44.279286 2552 patch_prober.go:28] interesting pod/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 08 18:10:44.279522 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:44.279344 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" podUID="aa5e765a-f130-491b-b046-43723d04319e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 08 18:10:45.284574 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:45.284518 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:45.285860 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:45.285836 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:10:48.704814 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:48.704783 2552 generic.go:356] "Generic (PLEG): container finished" podID="46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd" containerID="7a211d315a52d123c8fcc361778edf7fcba0fbf8c5c3839fc05290a131d77028" exitCode=0 Jul 08 18:10:48.705287 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:48.704862 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" event={"ID":"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd","Type":"ContainerDied","Data":"7a211d315a52d123c8fcc361778edf7fcba0fbf8c5c3839fc05290a131d77028"} Jul 08 18:10:48.705287 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:48.705258 2552 scope.go:117] "RemoveContainer" containerID="7a211d315a52d123c8fcc361778edf7fcba0fbf8c5c3839fc05290a131d77028" Jul 08 18:10:48.706284 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:48.706253 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:10:48.706381 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:48.706320 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:10:48.706381 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:48.706371 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:10:49.314471 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:49.314441 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:10:49.411398 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:49.411365 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:10:49.610930 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:49.610834 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:49.712462 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:49.712425 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" event={"ID":"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd","Type":"ContainerStarted","Data":"f44eceef561d3ba328c53997494018c014f2faa525570747e9f57fff3d8c68bf"} Jul 08 18:10:50.235093 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:50.235057 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:50.236682 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:50.236649 2552 patch_prober.go:28] interesting pod/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 08 18:10:50.236834 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:50.236709 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" podUID="46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 08 18:10:51.235238 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:51.235197 2552 patch_prober.go:28] interesting pod/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 08 18:10:51.235871 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:51.235839 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" podUID="46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 08 18:10:52.236046 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:52.236009 2552 patch_prober.go:28] interesting pod/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 08 18:10:52.236705 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:52.236673 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" podUID="46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 08 18:10:53.235523 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:53.235472 2552 patch_prober.go:28] interesting pod/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 08 18:10:53.235758 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:53.235587 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" podUID="46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 08 18:10:54.239787 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:54.239760 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:54.240289 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:54.240149 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:54.240936 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:54.240916 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:10:57.987628 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:57.987594 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:10:58.087092 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:10:58.087058 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:11:05.019067 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:11:05.019006 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:11:10.875558 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:11:10.875507 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:11:36.690509 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:11:36.690477 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:11:40.532456 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:11:40.532425 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:11:43.757754 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:11:43.757718 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:11:59.353472 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:11:59.353437 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:12:00.226600 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:00.226566 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:12:00.426415 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:00.426378 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:12:00.816222 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:00.816188 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:12:00.917585 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:00.917554 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:12:01.017526 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:01.017495 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:12:01.157958 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:01.157871 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:12:05.892214 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:05.892175 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:12:43.370523 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:43.370488 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:12:43.629914 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:43.629820 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9"] Jul 08 18:12:43.630104 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:43.630079 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" podUID="aa5e765a-f130-491b-b046-43723d04319e" containerName="istio-proxy" containerID="cri-o://16e96d13706c49f8b389962ce36c33614bdf326d0c6f768630f5506a81fa7531" gracePeriod=30 Jul 08 18:12:43.648293 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:43.648265 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:12:44.060832 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:44.060800 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:12:44.439196 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:44.439094 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:12:44.538046 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:44.538011 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:12:44.664434 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:44.664385 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:12:44.884006 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:44.883964 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:12:45.287663 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:45.287622 2552 patch_prober.go:28] interesting pod/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 08 18:12:45.287828 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:45.287716 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" podUID="aa5e765a-f130-491b-b046-43723d04319e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 18:12:48.890150 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:48.890125 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:12:49.041738 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.041708 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa5e765a-f130-491b-b046-43723d04319e-istio-envoy\") pod \"aa5e765a-f130-491b-b046-43723d04319e\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " Jul 08 18:12:49.041738 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.041744 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa5e765a-f130-491b-b046-43723d04319e-workload-certs\") pod \"aa5e765a-f130-491b-b046-43723d04319e\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " Jul 08 18:12:49.042005 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.041773 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa5e765a-f130-491b-b046-43723d04319e-istiod-ca-cert\") pod \"aa5e765a-f130-491b-b046-43723d04319e\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " Jul 08 18:12:49.042005 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.041800 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa5e765a-f130-491b-b046-43723d04319e-istio-data\") pod \"aa5e765a-f130-491b-b046-43723d04319e\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " Jul 08 18:12:49.042005 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.041830 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rn46r\" (UniqueName: \"kubernetes.io/projected/aa5e765a-f130-491b-b046-43723d04319e-kube-api-access-rn46r\") pod \"aa5e765a-f130-491b-b046-43723d04319e\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " Jul 08 18:12:49.042005 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.041851 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa5e765a-f130-491b-b046-43723d04319e-istio-token\") pod \"aa5e765a-f130-491b-b046-43723d04319e\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " Jul 08 18:12:49.042005 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.041897 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa5e765a-f130-491b-b046-43723d04319e-workload-socket\") pod \"aa5e765a-f130-491b-b046-43723d04319e\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " Jul 08 18:12:49.042005 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.041962 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa5e765a-f130-491b-b046-43723d04319e-credential-socket\") pod \"aa5e765a-f130-491b-b046-43723d04319e\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " Jul 08 18:12:49.042005 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.041993 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa5e765a-f130-491b-b046-43723d04319e-istio-podinfo\") pod \"aa5e765a-f130-491b-b046-43723d04319e\" (UID: \"aa5e765a-f130-491b-b046-43723d04319e\") " Jul 08 18:12:49.042367 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.042204 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa5e765a-f130-491b-b046-43723d04319e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aa5e765a-f130-491b-b046-43723d04319e" (UID: "aa5e765a-f130-491b-b046-43723d04319e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:12:49.042367 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.042274 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa5e765a-f130-491b-b046-43723d04319e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aa5e765a-f130-491b-b046-43723d04319e" (UID: "aa5e765a-f130-491b-b046-43723d04319e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:12:49.042474 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.042374 2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa5e765a-f130-491b-b046-43723d04319e-istiod-ca-cert\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:12:49.042474 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.042393 2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa5e765a-f130-491b-b046-43723d04319e-workload-socket\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:12:49.042621 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.042485 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa5e765a-f130-491b-b046-43723d04319e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aa5e765a-f130-491b-b046-43723d04319e" (UID: "aa5e765a-f130-491b-b046-43723d04319e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:12:49.042621 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.042605 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa5e765a-f130-491b-b046-43723d04319e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aa5e765a-f130-491b-b046-43723d04319e" (UID: "aa5e765a-f130-491b-b046-43723d04319e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:12:49.043159 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.043129 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa5e765a-f130-491b-b046-43723d04319e-istio-data" (OuterVolumeSpecName: "istio-data") pod "aa5e765a-f130-491b-b046-43723d04319e" (UID: "aa5e765a-f130-491b-b046-43723d04319e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:12:49.044173 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.044152 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa5e765a-f130-491b-b046-43723d04319e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aa5e765a-f130-491b-b046-43723d04319e" (UID: "aa5e765a-f130-491b-b046-43723d04319e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:12:49.044458 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.044438 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa5e765a-f130-491b-b046-43723d04319e-istio-token" (OuterVolumeSpecName: "istio-token") pod "aa5e765a-f130-491b-b046-43723d04319e" (UID: "aa5e765a-f130-491b-b046-43723d04319e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:12:49.044531 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.044437 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aa5e765a-f130-491b-b046-43723d04319e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aa5e765a-f130-491b-b046-43723d04319e" (UID: "aa5e765a-f130-491b-b046-43723d04319e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 18:12:49.044531 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.044456 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa5e765a-f130-491b-b046-43723d04319e-kube-api-access-rn46r" (OuterVolumeSpecName: "kube-api-access-rn46r") pod "aa5e765a-f130-491b-b046-43723d04319e" (UID: "aa5e765a-f130-491b-b046-43723d04319e"). InnerVolumeSpecName "kube-api-access-rn46r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:12:49.143030 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.142995 2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa5e765a-f130-491b-b046-43723d04319e-istio-envoy\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:12:49.143030 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.143024 2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa5e765a-f130-491b-b046-43723d04319e-workload-certs\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:12:49.143030 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.143034 2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa5e765a-f130-491b-b046-43723d04319e-istio-data\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:12:49.143270 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.143043 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rn46r\" (UniqueName: \"kubernetes.io/projected/aa5e765a-f130-491b-b046-43723d04319e-kube-api-access-rn46r\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:12:49.143270 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.143053 2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa5e765a-f130-491b-b046-43723d04319e-istio-token\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:12:49.143270 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.143062 2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa5e765a-f130-491b-b046-43723d04319e-credential-socket\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:12:49.143270 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.143070 2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa5e765a-f130-491b-b046-43723d04319e-istio-podinfo\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:12:49.364571 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.364460 2552 generic.go:356] "Generic (PLEG): container finished" podID="aa5e765a-f130-491b-b046-43723d04319e" containerID="16e96d13706c49f8b389962ce36c33614bdf326d0c6f768630f5506a81fa7531" exitCode=0 Jul 08 18:12:49.364571 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.364515 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" Jul 08 18:12:49.364571 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.364563 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" event={"ID":"aa5e765a-f130-491b-b046-43723d04319e","Type":"ContainerDied","Data":"16e96d13706c49f8b389962ce36c33614bdf326d0c6f768630f5506a81fa7531"} Jul 08 18:12:49.364851 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.364618 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9" event={"ID":"aa5e765a-f130-491b-b046-43723d04319e","Type":"ContainerDied","Data":"368af8419ef71698cc6cbc6f3b47633414e9356cf3c27196fd58aeadd1fe264f"} Jul 08 18:12:49.364851 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.364640 2552 scope.go:117] "RemoveContainer" containerID="16e96d13706c49f8b389962ce36c33614bdf326d0c6f768630f5506a81fa7531" Jul 08 18:12:49.374077 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.374059 2552 scope.go:117] "RemoveContainer" containerID="25cb73e0444cc2a2aed18c4aebcf99ee8e8c77391759a7e3dd2c2939fc6e3b76" Jul 08 18:12:49.383063 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.383046 2552 scope.go:117] "RemoveContainer" containerID="16e96d13706c49f8b389962ce36c33614bdf326d0c6f768630f5506a81fa7531" Jul 08 18:12:49.383312 ip-10-0-130-38 kubenswrapper[2552]: E0708 18:12:49.383292 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16e96d13706c49f8b389962ce36c33614bdf326d0c6f768630f5506a81fa7531\": container with ID starting with 16e96d13706c49f8b389962ce36c33614bdf326d0c6f768630f5506a81fa7531 not found: ID does not exist" containerID="16e96d13706c49f8b389962ce36c33614bdf326d0c6f768630f5506a81fa7531" Jul 08 18:12:49.383369 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.383320 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16e96d13706c49f8b389962ce36c33614bdf326d0c6f768630f5506a81fa7531"} err="failed to get container status \"16e96d13706c49f8b389962ce36c33614bdf326d0c6f768630f5506a81fa7531\": rpc error: code = NotFound desc = could not find container \"16e96d13706c49f8b389962ce36c33614bdf326d0c6f768630f5506a81fa7531\": container with ID starting with 16e96d13706c49f8b389962ce36c33614bdf326d0c6f768630f5506a81fa7531 not found: ID does not exist" Jul 08 18:12:49.383369 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.383338 2552 scope.go:117] "RemoveContainer" containerID="25cb73e0444cc2a2aed18c4aebcf99ee8e8c77391759a7e3dd2c2939fc6e3b76" Jul 08 18:12:49.383590 ip-10-0-130-38 kubenswrapper[2552]: E0708 18:12:49.383572 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25cb73e0444cc2a2aed18c4aebcf99ee8e8c77391759a7e3dd2c2939fc6e3b76\": container with ID starting with 25cb73e0444cc2a2aed18c4aebcf99ee8e8c77391759a7e3dd2c2939fc6e3b76 not found: ID does not exist" containerID="25cb73e0444cc2a2aed18c4aebcf99ee8e8c77391759a7e3dd2c2939fc6e3b76" Jul 08 18:12:49.383640 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.383599 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25cb73e0444cc2a2aed18c4aebcf99ee8e8c77391759a7e3dd2c2939fc6e3b76"} err="failed to get container status \"25cb73e0444cc2a2aed18c4aebcf99ee8e8c77391759a7e3dd2c2939fc6e3b76\": rpc error: code = NotFound desc = could not find container \"25cb73e0444cc2a2aed18c4aebcf99ee8e8c77391759a7e3dd2c2939fc6e3b76\": container with ID starting with 25cb73e0444cc2a2aed18c4aebcf99ee8e8c77391759a7e3dd2c2939fc6e3b76 not found: ID does not exist" Jul 08 18:12:49.388966 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.388947 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9"] Jul 08 18:12:49.392433 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:49.392413 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-975810-openshift-default-68bb5cc6f7-h95l9"] Jul 08 18:12:50.306848 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:50.306816 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa5e765a-f130-491b-b046-43723d04319e" path="/var/lib/kubelet/pods/aa5e765a-f130-491b-b046-43723d04319e/volumes" Jul 08 18:12:51.299739 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:51.299699 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:12:51.399829 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:51.399797 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:12:51.567397 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:51.567302 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:12:51.569273 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:51.569254 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch"] Jul 08 18:12:51.569529 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:51.569509 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" podUID="46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd" containerName="istio-proxy" containerID="cri-o://f44eceef561d3ba328c53997494018c014f2faa525570747e9f57fff3d8c68bf" gracePeriod=30 Jul 08 18:12:51.775386 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:51.775351 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:12:51.874983 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:51.874856 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:12:52.111333 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.111282 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:12:52.401210 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.401178 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p"] Jul 08 18:12:52.401619 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.401604 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa5e765a-f130-491b-b046-43723d04319e" containerName="istio-proxy" Jul 08 18:12:52.401670 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.401620 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa5e765a-f130-491b-b046-43723d04319e" containerName="istio-proxy" Jul 08 18:12:52.401670 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.401628 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa5e765a-f130-491b-b046-43723d04319e" containerName="istio-proxy" Jul 08 18:12:52.401670 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.401634 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa5e765a-f130-491b-b046-43723d04319e" containerName="istio-proxy" Jul 08 18:12:52.401767 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.401730 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa5e765a-f130-491b-b046-43723d04319e" containerName="istio-proxy" Jul 08 18:12:52.404716 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.404697 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:12:52.407047 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.407030 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-f4e475-openshift-default-dockercfg-sq5bn\"" Jul 08 18:12:52.416458 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.416431 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p"] Jul 08 18:12:52.476784 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.476748 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/311c5517-0910-4782-bd87-24e7f55ed00a-credential-socket\") pod \"e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:12:52.476965 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.476803 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/311c5517-0910-4782-bd87-24e7f55ed00a-istio-token\") pod \"e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:12:52.476965 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.476868 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/311c5517-0910-4782-bd87-24e7f55ed00a-istio-data\") pod \"e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:12:52.476965 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.476893 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/311c5517-0910-4782-bd87-24e7f55ed00a-workload-socket\") pod \"e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:12:52.476965 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.476925 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z87v2\" (UniqueName: \"kubernetes.io/projected/311c5517-0910-4782-bd87-24e7f55ed00a-kube-api-access-z87v2\") pod \"e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:12:52.477146 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.477000 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/311c5517-0910-4782-bd87-24e7f55ed00a-istio-envoy\") pod \"e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:12:52.477146 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.477081 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/311c5517-0910-4782-bd87-24e7f55ed00a-istio-podinfo\") pod \"e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:12:52.477146 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.477106 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/311c5517-0910-4782-bd87-24e7f55ed00a-istiod-ca-cert\") pod \"e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:12:52.477254 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.477156 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/311c5517-0910-4782-bd87-24e7f55ed00a-workload-certs\") pod \"e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:12:52.578463 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.578432 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/311c5517-0910-4782-bd87-24e7f55ed00a-istio-token\") pod \"e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:12:52.578646 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.578475 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/311c5517-0910-4782-bd87-24e7f55ed00a-istio-data\") pod \"e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:12:52.578646 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.578597 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/311c5517-0910-4782-bd87-24e7f55ed00a-workload-socket\") pod \"e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:12:52.578646 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.578644 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z87v2\" (UniqueName: \"kubernetes.io/projected/311c5517-0910-4782-bd87-24e7f55ed00a-kube-api-access-z87v2\") pod \"e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:12:52.578834 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.578683 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/311c5517-0910-4782-bd87-24e7f55ed00a-istio-envoy\") pod \"e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:12:52.578834 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.578724 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/311c5517-0910-4782-bd87-24e7f55ed00a-istio-podinfo\") pod \"e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:12:52.578937 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.578869 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/311c5517-0910-4782-bd87-24e7f55ed00a-istiod-ca-cert\") pod \"e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:12:52.578995 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.578950 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/311c5517-0910-4782-bd87-24e7f55ed00a-workload-certs\") pod \"e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:12:52.578995 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.578971 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/311c5517-0910-4782-bd87-24e7f55ed00a-workload-socket\") pod \"e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:12:52.578995 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.578876 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/311c5517-0910-4782-bd87-24e7f55ed00a-istio-data\") pod \"e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:12:52.579158 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.579001 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/311c5517-0910-4782-bd87-24e7f55ed00a-credential-socket\") pod \"e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:12:52.579266 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.579243 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/311c5517-0910-4782-bd87-24e7f55ed00a-workload-certs\") pod \"e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:12:52.579346 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.579326 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/311c5517-0910-4782-bd87-24e7f55ed00a-credential-socket\") pod \"e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:12:52.579717 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.579696 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/311c5517-0910-4782-bd87-24e7f55ed00a-istiod-ca-cert\") pod \"e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:12:52.581114 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.581093 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/311c5517-0910-4782-bd87-24e7f55ed00a-istio-envoy\") pod \"e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:12:52.581321 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.581305 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/311c5517-0910-4782-bd87-24e7f55ed00a-istio-podinfo\") pod \"e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:12:52.588013 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.587987 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/311c5517-0910-4782-bd87-24e7f55ed00a-istio-token\") pod \"e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:12:52.588802 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.588787 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z87v2\" (UniqueName: \"kubernetes.io/projected/311c5517-0910-4782-bd87-24e7f55ed00a-kube-api-access-z87v2\") pod \"e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:12:52.714785 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.714756 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:12:52.719576 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.719555 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:12:52.781689 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.781642 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:12:52.873273 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.873247 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p"] Jul 08 18:12:52.874396 ip-10-0-130-38 kubenswrapper[2552]: W0708 18:12:52.874376 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod311c5517_0910_4782_bd87_24e7f55ed00a.slice/crio-810dc76994f5879d2e123d172db5434de0098f4743a731e68d9841c98c3d48e9 WatchSource:0}: Error finding container 810dc76994f5879d2e123d172db5434de0098f4743a731e68d9841c98c3d48e9: Status 404 returned error can't find the container with id 810dc76994f5879d2e123d172db5434de0098f4743a731e68d9841c98c3d48e9 Jul 08 18:12:52.877073 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.877040 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:12:52.877156 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.877106 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:12:52.877156 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:52.877133 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:12:53.391902 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:53.391863 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" event={"ID":"311c5517-0910-4782-bd87-24e7f55ed00a","Type":"ContainerStarted","Data":"45212dbc7004de26b3d9229f7cbf40f2e839a864c6971651a4597ce471b227df"} Jul 08 18:12:53.392094 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:53.391930 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" event={"ID":"311c5517-0910-4782-bd87-24e7f55ed00a","Type":"ContainerStarted","Data":"810dc76994f5879d2e123d172db5434de0098f4743a731e68d9841c98c3d48e9"} Jul 08 18:12:53.429961 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:53.429906 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" podStartSLOduration=1.429888686 podStartE2EDuration="1.429888686s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:12:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:12:53.424442349 +0000 UTC m=+2371.660834602" watchObservedRunningTime="2026-07-08 18:12:53.429888686 +0000 UTC m=+2371.666280939" Jul 08 18:12:53.715709 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:53.715671 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:12:53.720874 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:53.720849 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:12:54.242628 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:54.242588 2552 patch_prober.go:28] interesting pod/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 08 18:12:54.242795 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:54.242644 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" podUID="46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 18:12:54.397405 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:54.397374 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:12:54.398260 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:54.398240 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:12:55.409611 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:55.409579 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:12:55.541911 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:55.541871 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:12:55.637564 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:55.637514 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:12:55.999245 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:55.999217 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:12:56.198783 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:56.198720 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:12:56.299272 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:56.299172 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:12:56.830349 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:56.830278 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:12:56.920106 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:56.920075 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-istio-data\") pod \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " Jul 08 18:12:56.920106 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:56.920114 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-istio-envoy\") pod \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " Jul 08 18:12:56.920366 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:56.920152 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-istio-token\") pod \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " Jul 08 18:12:56.920366 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:56.920177 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7pk6\" (UniqueName: \"kubernetes.io/projected/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-kube-api-access-r7pk6\") pod \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " Jul 08 18:12:56.920366 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:56.920215 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-workload-socket\") pod \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " Jul 08 18:12:56.920366 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:56.920259 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-workload-certs\") pod \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " Jul 08 18:12:56.920366 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:56.920313 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-istiod-ca-cert\") pod \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " Jul 08 18:12:56.920366 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:56.920349 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-credential-socket\") pod \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " Jul 08 18:12:56.920733 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:56.920385 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-istio-podinfo\") pod \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\" (UID: \"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd\") " Jul 08 18:12:56.920899 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:56.920779 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd" (UID: "46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:12:56.920899 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:56.920875 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd" (UID: "46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:12:56.921000 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:56.920891 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd" (UID: "46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:12:56.921000 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:56.920971 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd" (UID: "46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:12:56.921103 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:56.921006 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-istio-data" (OuterVolumeSpecName: "istio-data") pod "46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd" (UID: "46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:12:56.921678 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:56.921613 2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-istiod-ca-cert\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:12:56.921678 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:56.921640 2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-credential-socket\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:12:56.921678 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:56.921653 2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-istio-data\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:12:56.921678 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:56.921667 2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-workload-socket\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:12:56.921678 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:56.921679 2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-workload-certs\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:12:56.922883 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:56.922848 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-istio-token" (OuterVolumeSpecName: "istio-token") pod "46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd" (UID: "46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:12:56.923283 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:56.923250 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-kube-api-access-r7pk6" (OuterVolumeSpecName: "kube-api-access-r7pk6") pod "46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd" (UID: "46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd"). InnerVolumeSpecName "kube-api-access-r7pk6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:12:56.923347 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:56.923333 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd" (UID: "46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:12:56.923423 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:56.923409 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd" (UID: "46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 18:12:57.022384 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:57.022351 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7pk6\" (UniqueName: \"kubernetes.io/projected/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-kube-api-access-r7pk6\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:12:57.022384 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:57.022378 2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-istio-podinfo\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:12:57.022384 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:57.022388 2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-istio-envoy\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:12:57.022630 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:57.022396 2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd-istio-token\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:12:57.415184 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:57.415152 2552 generic.go:356] "Generic (PLEG): container finished" podID="46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd" containerID="f44eceef561d3ba328c53997494018c014f2faa525570747e9f57fff3d8c68bf" exitCode=0 Jul 08 18:12:57.415349 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:57.415213 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" Jul 08 18:12:57.415349 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:57.415204 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" event={"ID":"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd","Type":"ContainerDied","Data":"f44eceef561d3ba328c53997494018c014f2faa525570747e9f57fff3d8c68bf"} Jul 08 18:12:57.415349 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:57.415340 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch" event={"ID":"46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd","Type":"ContainerDied","Data":"2e84ef4858b70c816e5ca58a3c9f62a62c05015446b8b74d0aa483a58198d2ab"} Jul 08 18:12:57.415517 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:57.415367 2552 scope.go:117] "RemoveContainer" containerID="f44eceef561d3ba328c53997494018c014f2faa525570747e9f57fff3d8c68bf" Jul 08 18:12:57.427351 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:57.427333 2552 scope.go:117] "RemoveContainer" containerID="7a211d315a52d123c8fcc361778edf7fcba0fbf8c5c3839fc05290a131d77028" Jul 08 18:12:57.435952 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:57.435934 2552 scope.go:117] "RemoveContainer" containerID="f44eceef561d3ba328c53997494018c014f2faa525570747e9f57fff3d8c68bf" Jul 08 18:12:57.436244 ip-10-0-130-38 kubenswrapper[2552]: E0708 18:12:57.436211 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f44eceef561d3ba328c53997494018c014f2faa525570747e9f57fff3d8c68bf\": container with ID starting with f44eceef561d3ba328c53997494018c014f2faa525570747e9f57fff3d8c68bf not found: ID does not exist" containerID="f44eceef561d3ba328c53997494018c014f2faa525570747e9f57fff3d8c68bf" Jul 08 18:12:57.436362 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:57.436244 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f44eceef561d3ba328c53997494018c014f2faa525570747e9f57fff3d8c68bf"} err="failed to get container status \"f44eceef561d3ba328c53997494018c014f2faa525570747e9f57fff3d8c68bf\": rpc error: code = NotFound desc = could not find container \"f44eceef561d3ba328c53997494018c014f2faa525570747e9f57fff3d8c68bf\": container with ID starting with f44eceef561d3ba328c53997494018c014f2faa525570747e9f57fff3d8c68bf not found: ID does not exist" Jul 08 18:12:57.436362 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:57.436267 2552 scope.go:117] "RemoveContainer" containerID="7a211d315a52d123c8fcc361778edf7fcba0fbf8c5c3839fc05290a131d77028" Jul 08 18:12:57.436653 ip-10-0-130-38 kubenswrapper[2552]: E0708 18:12:57.436566 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a211d315a52d123c8fcc361778edf7fcba0fbf8c5c3839fc05290a131d77028\": container with ID starting with 7a211d315a52d123c8fcc361778edf7fcba0fbf8c5c3839fc05290a131d77028 not found: ID does not exist" containerID="7a211d315a52d123c8fcc361778edf7fcba0fbf8c5c3839fc05290a131d77028" Jul 08 18:12:57.436653 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:57.436600 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a211d315a52d123c8fcc361778edf7fcba0fbf8c5c3839fc05290a131d77028"} err="failed to get container status \"7a211d315a52d123c8fcc361778edf7fcba0fbf8c5c3839fc05290a131d77028\": rpc error: code = NotFound desc = could not find container \"7a211d315a52d123c8fcc361778edf7fcba0fbf8c5c3839fc05290a131d77028\": container with ID starting with 7a211d315a52d123c8fcc361778edf7fcba0fbf8c5c3839fc05290a131d77028 not found: ID does not exist" Jul 08 18:12:57.438584 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:57.438565 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch"] Jul 08 18:12:57.442472 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:57.442453 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-3be673-openshift-default-f6b85c8c5-94xch"] Jul 08 18:12:58.307141 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:58.307106 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd" path="/var/lib/kubelet/pods/46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd/volumes" Jul 08 18:12:59.851666 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:12:59.851604 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:00.509226 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.509196 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:00.573908 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.573876 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck"] Jul 08 18:13:00.574258 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.574245 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd" containerName="istio-proxy" Jul 08 18:13:00.574303 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.574260 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd" containerName="istio-proxy" Jul 08 18:13:00.574303 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.574272 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd" containerName="istio-proxy" Jul 08 18:13:00.574303 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.574277 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd" containerName="istio-proxy" Jul 08 18:13:00.574398 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.574337 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd" containerName="istio-proxy" Jul 08 18:13:00.574398 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.574348 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa5e765a-f130-491b-b046-43723d04319e" containerName="istio-proxy" Jul 08 18:13:00.574398 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.574354 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="46fb3b1e-4c6e-4bc5-9429-f3df0951dcbd" containerName="istio-proxy" Jul 08 18:13:00.576980 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.576963 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:00.579970 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.579952 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-761617-openshift-default-dockercfg-cgg8x\"" Jul 08 18:13:00.591640 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.591613 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck"] Jul 08 18:13:00.620714 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.620682 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:00.758228 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.758197 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-istio-token\") pod \"e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:00.758392 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.758237 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-istio-podinfo\") pod \"e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:00.758392 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.758269 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-istio-data\") pod \"e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:00.758392 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.758313 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-credential-socket\") pod \"e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:00.758392 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.758343 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-workload-certs\") pod \"e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:00.758532 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.758407 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-istiod-ca-cert\") pod \"e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:00.758532 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.758439 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-istio-envoy\") pod \"e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:00.758532 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.758457 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv2zx\" (UniqueName: \"kubernetes.io/projected/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-kube-api-access-wv2zx\") pod \"e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:00.758532 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.758477 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-workload-socket\") pod \"e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:00.759940 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.759874 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:00.859699 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.859659 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-istiod-ca-cert\") pod \"e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:00.860122 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.859717 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-istio-envoy\") pod \"e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:00.860122 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.859739 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv2zx\" (UniqueName: \"kubernetes.io/projected/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-kube-api-access-wv2zx\") pod \"e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:00.860122 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.859761 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-workload-socket\") pod \"e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:00.860122 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.859840 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-istio-token\") pod \"e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:00.860122 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.859890 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-istio-podinfo\") pod \"e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:00.860122 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.859918 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-istio-data\") pod \"e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:00.860122 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.859959 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-credential-socket\") pod \"e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:00.860122 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.860003 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-workload-certs\") pod \"e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:00.860606 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.860285 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-workload-socket\") pod \"e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:00.860606 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.860401 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-credential-socket\") pod \"e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:00.860606 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.860450 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-workload-certs\") pod \"e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:00.860606 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.860485 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-istiod-ca-cert\") pod \"e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:00.860606 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.860527 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-istio-data\") pod \"e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:00.862312 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.862294 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-istio-envoy\") pod \"e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:00.862450 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.862434 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-istio-podinfo\") pod \"e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:00.867821 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.867802 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-istio-token\") pod \"e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:00.867910 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.867853 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv2zx\" (UniqueName: \"kubernetes.io/projected/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-kube-api-access-wv2zx\") pod \"e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:00.887902 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:00.887881 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:01.036570 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:01.036518 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck"] Jul 08 18:13:01.038711 ip-10-0-130-38 kubenswrapper[2552]: W0708 18:13:01.038680 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae3b1821_b1a0_4ac9_a3e4_dc1983d66eca.slice/crio-87db15a79c7826774562142abe68786ace8d3ec8876ac9ae310be0ba06f7a978 WatchSource:0}: Error finding container 87db15a79c7826774562142abe68786ace8d3ec8876ac9ae310be0ba06f7a978: Status 404 returned error can't find the container with id 87db15a79c7826774562142abe68786ace8d3ec8876ac9ae310be0ba06f7a978 Jul 08 18:13:01.040804 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:01.040772 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:13:01.040887 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:01.040840 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:13:01.040887 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:01.040868 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:13:01.440522 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:01.440495 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" event={"ID":"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca","Type":"ContainerStarted","Data":"40f485ff4137a0687042d169bfe2f045da7e655078cc235d8ed96e8cae992f7e"} Jul 08 18:13:01.440713 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:01.440598 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" event={"ID":"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca","Type":"ContainerStarted","Data":"87db15a79c7826774562142abe68786ace8d3ec8876ac9ae310be0ba06f7a978"} Jul 08 18:13:01.489072 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:01.489021 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" podStartSLOduration=1.489003901 podStartE2EDuration="1.489003901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:13:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:13:01.485082334 +0000 UTC m=+2379.721474587" watchObservedRunningTime="2026-07-08 18:13:01.489003901 +0000 UTC m=+2379.725396153" Jul 08 18:13:01.888123 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:01.888033 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:02.893750 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:02.893717 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:03.410228 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:03.410197 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:03.451378 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:03.451349 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:03.452295 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:03.452275 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:03.511711 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:03.511662 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:03.599249 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:03.599217 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:03.792517 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:03.792485 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:03.952902 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:03.952875 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:04.049633 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:04.049480 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:07.881567 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:07.881494 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:10.439737 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:10.439697 2552 patch_prober.go:28] interesting pod/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 08 18:13:10.440129 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:10.439756 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" podUID="311c5517-0910-4782-bd87-24e7f55ed00a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 08 18:13:11.495439 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:11.495409 2552 generic.go:356] "Generic (PLEG): container finished" podID="311c5517-0910-4782-bd87-24e7f55ed00a" containerID="45212dbc7004de26b3d9229f7cbf40f2e839a864c6971651a4597ce471b227df" exitCode=0 Jul 08 18:13:11.495870 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:11.495484 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" event={"ID":"311c5517-0910-4782-bd87-24e7f55ed00a","Type":"ContainerDied","Data":"45212dbc7004de26b3d9229f7cbf40f2e839a864c6971651a4597ce471b227df"} Jul 08 18:13:11.495985 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:11.495966 2552 scope.go:117] "RemoveContainer" containerID="45212dbc7004de26b3d9229f7cbf40f2e839a864c6971651a4597ce471b227df" Jul 08 18:13:11.497015 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:11.496983 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:13:11.497079 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:11.497065 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:13:11.497121 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:11.497108 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:13:12.502696 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:12.502661 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" event={"ID":"311c5517-0910-4782-bd87-24e7f55ed00a","Type":"ContainerStarted","Data":"5c68c465f7b65ed61a2762544095e091efd056215c5d2cc0770c1f79d322fc2f"} Jul 08 18:13:12.715037 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:12.715007 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:13:12.715221 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:12.715177 2552 patch_prober.go:28] interesting pod/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 08 18:13:12.715278 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:12.715251 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" podUID="311c5517-0910-4782-bd87-24e7f55ed00a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 08 18:13:13.715338 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:13.715302 2552 patch_prober.go:28] interesting pod/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 08 18:13:13.715780 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:13.715364 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" podUID="311c5517-0910-4782-bd87-24e7f55ed00a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 08 18:13:14.715501 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:14.715461 2552 patch_prober.go:28] interesting pod/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 08 18:13:14.715937 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:14.715522 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" podUID="311c5517-0910-4782-bd87-24e7f55ed00a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 08 18:13:15.715265 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:15.715230 2552 patch_prober.go:28] interesting pod/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 08 18:13:15.715440 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:15.715282 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" podUID="311c5517-0910-4782-bd87-24e7f55ed00a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 08 18:13:16.131023 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:16.130919 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:16.522904 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:16.522861 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:16.718928 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:16.718892 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:13:16.719337 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:16.719314 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:13:16.724086 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:16.724035 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:13:16.778174 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:16.778095 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:16.875875 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:16.875846 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:17.169622 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:17.169510 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:19.494732 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:19.494694 2552 patch_prober.go:28] interesting pod/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 08 18:13:19.495091 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:19.494778 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" podUID="ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 08 18:13:20.551626 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:20.551593 2552 generic.go:356] "Generic (PLEG): container finished" podID="ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca" containerID="40f485ff4137a0687042d169bfe2f045da7e655078cc235d8ed96e8cae992f7e" exitCode=0 Jul 08 18:13:20.552062 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:20.551666 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" event={"ID":"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca","Type":"ContainerDied","Data":"40f485ff4137a0687042d169bfe2f045da7e655078cc235d8ed96e8cae992f7e"} Jul 08 18:13:20.552109 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:20.552060 2552 scope.go:117] "RemoveContainer" containerID="40f485ff4137a0687042d169bfe2f045da7e655078cc235d8ed96e8cae992f7e" Jul 08 18:13:20.553129 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:20.553098 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:13:20.553211 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:20.553195 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:13:20.553254 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:20.553241 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:13:21.559205 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:21.559172 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" event={"ID":"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca","Type":"ContainerStarted","Data":"d4b853cc430279690c90cd625fdfa3f02be370ec0c2f58c0fb4ae516d5ebd774"} Jul 08 18:13:21.888946 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:21.888858 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:21.889135 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:21.889111 2552 patch_prober.go:28] interesting pod/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 08 18:13:21.889214 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:21.889170 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" podUID="ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 08 18:13:22.447950 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:22.447911 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-mnhqg_058a4314-4829-4b3d-a275-477b305bcf91/console-operator/1.log" Jul 08 18:13:22.457733 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:22.457695 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-mnhqg_058a4314-4829-4b3d-a275-477b305bcf91/console-operator/1.log" Jul 08 18:13:22.888750 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:22.888663 2552 patch_prober.go:28] interesting pod/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 08 18:13:22.888750 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:22.888728 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" podUID="ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 08 18:13:23.272498 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:23.272464 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:23.346166 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:23.346134 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:23.545606 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:23.539465 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p"] Jul 08 18:13:23.546498 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:23.546426 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" podUID="311c5517-0910-4782-bd87-24e7f55ed00a" containerName="istio-proxy" containerID="cri-o://5c68c465f7b65ed61a2762544095e091efd056215c5d2cc0770c1f79d322fc2f" gracePeriod=30 Jul 08 18:13:23.556330 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:23.556267 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:23.888849 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:23.888748 2552 patch_prober.go:28] interesting pod/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 08 18:13:23.888849 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:23.888805 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" podUID="ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 08 18:13:23.929345 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:23.929309 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:24.327671 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:24.327629 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:24.429390 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:24.429348 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:24.529827 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:24.529788 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:24.660393 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:24.660297 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:24.888460 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:24.888421 2552 patch_prober.go:28] interesting pod/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 08 18:13:24.888644 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:24.888481 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" podUID="ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 08 18:13:25.891704 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:25.891677 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:25.892172 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:25.892143 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:25.892970 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:25.892949 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:28.802338 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:28.802315 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:13:28.843831 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:28.843762 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/311c5517-0910-4782-bd87-24e7f55ed00a-istio-podinfo\") pod \"311c5517-0910-4782-bd87-24e7f55ed00a\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " Jul 08 18:13:28.843968 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:28.843829 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/311c5517-0910-4782-bd87-24e7f55ed00a-workload-socket\") pod \"311c5517-0910-4782-bd87-24e7f55ed00a\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " Jul 08 18:13:28.843968 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:28.843855 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/311c5517-0910-4782-bd87-24e7f55ed00a-credential-socket\") pod \"311c5517-0910-4782-bd87-24e7f55ed00a\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " Jul 08 18:13:28.843968 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:28.843881 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/311c5517-0910-4782-bd87-24e7f55ed00a-workload-certs\") pod \"311c5517-0910-4782-bd87-24e7f55ed00a\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " Jul 08 18:13:28.843968 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:28.843941 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/311c5517-0910-4782-bd87-24e7f55ed00a-istio-token\") pod \"311c5517-0910-4782-bd87-24e7f55ed00a\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " Jul 08 18:13:28.843968 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:28.843964 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/311c5517-0910-4782-bd87-24e7f55ed00a-istio-envoy\") pod \"311c5517-0910-4782-bd87-24e7f55ed00a\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " Jul 08 18:13:28.844225 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:28.844006 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/311c5517-0910-4782-bd87-24e7f55ed00a-istiod-ca-cert\") pod \"311c5517-0910-4782-bd87-24e7f55ed00a\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " Jul 08 18:13:28.844225 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:28.844038 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z87v2\" (UniqueName: \"kubernetes.io/projected/311c5517-0910-4782-bd87-24e7f55ed00a-kube-api-access-z87v2\") pod \"311c5517-0910-4782-bd87-24e7f55ed00a\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " Jul 08 18:13:28.844225 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:28.844082 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/311c5517-0910-4782-bd87-24e7f55ed00a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "311c5517-0910-4782-bd87-24e7f55ed00a" (UID: "311c5517-0910-4782-bd87-24e7f55ed00a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:13:28.844225 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:28.844102 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/311c5517-0910-4782-bd87-24e7f55ed00a-istio-data\") pod \"311c5517-0910-4782-bd87-24e7f55ed00a\" (UID: \"311c5517-0910-4782-bd87-24e7f55ed00a\") " Jul 08 18:13:28.844225 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:28.844189 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/311c5517-0910-4782-bd87-24e7f55ed00a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "311c5517-0910-4782-bd87-24e7f55ed00a" (UID: "311c5517-0910-4782-bd87-24e7f55ed00a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:13:28.844463 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:28.844240 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/311c5517-0910-4782-bd87-24e7f55ed00a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "311c5517-0910-4782-bd87-24e7f55ed00a" (UID: "311c5517-0910-4782-bd87-24e7f55ed00a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:13:28.844463 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:28.844419 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/311c5517-0910-4782-bd87-24e7f55ed00a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "311c5517-0910-4782-bd87-24e7f55ed00a" (UID: "311c5517-0910-4782-bd87-24e7f55ed00a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:13:28.844571 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:28.844488 2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/311c5517-0910-4782-bd87-24e7f55ed00a-workload-socket\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:13:28.844571 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:28.844508 2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/311c5517-0910-4782-bd87-24e7f55ed00a-credential-socket\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:13:28.844571 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:28.844519 2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/311c5517-0910-4782-bd87-24e7f55ed00a-workload-certs\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:13:28.844571 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:28.844528 2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/311c5517-0910-4782-bd87-24e7f55ed00a-istiod-ca-cert\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:13:28.845265 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:28.845235 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/311c5517-0910-4782-bd87-24e7f55ed00a-istio-data" (OuterVolumeSpecName: "istio-data") pod "311c5517-0910-4782-bd87-24e7f55ed00a" (UID: "311c5517-0910-4782-bd87-24e7f55ed00a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:13:28.846378 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:28.846355 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/311c5517-0910-4782-bd87-24e7f55ed00a-istio-token" (OuterVolumeSpecName: "istio-token") pod "311c5517-0910-4782-bd87-24e7f55ed00a" (UID: "311c5517-0910-4782-bd87-24e7f55ed00a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:13:28.846646 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:28.846612 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/311c5517-0910-4782-bd87-24e7f55ed00a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "311c5517-0910-4782-bd87-24e7f55ed00a" (UID: "311c5517-0910-4782-bd87-24e7f55ed00a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:13:28.846916 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:28.846894 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/311c5517-0910-4782-bd87-24e7f55ed00a-kube-api-access-z87v2" (OuterVolumeSpecName: "kube-api-access-z87v2") pod "311c5517-0910-4782-bd87-24e7f55ed00a" (UID: "311c5517-0910-4782-bd87-24e7f55ed00a"). InnerVolumeSpecName "kube-api-access-z87v2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:13:28.846988 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:28.846971 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/311c5517-0910-4782-bd87-24e7f55ed00a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "311c5517-0910-4782-bd87-24e7f55ed00a" (UID: "311c5517-0910-4782-bd87-24e7f55ed00a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 18:13:28.945657 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:28.945616 2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/311c5517-0910-4782-bd87-24e7f55ed00a-istio-data\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:13:28.945657 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:28.945648 2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/311c5517-0910-4782-bd87-24e7f55ed00a-istio-podinfo\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:13:28.945657 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:28.945660 2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/311c5517-0910-4782-bd87-24e7f55ed00a-istio-token\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:13:28.945897 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:28.945670 2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/311c5517-0910-4782-bd87-24e7f55ed00a-istio-envoy\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:13:28.945897 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:28.945683 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z87v2\" (UniqueName: \"kubernetes.io/projected/311c5517-0910-4782-bd87-24e7f55ed00a-kube-api-access-z87v2\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:13:29.632674 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:29.632640 2552 generic.go:356] "Generic (PLEG): container finished" podID="311c5517-0910-4782-bd87-24e7f55ed00a" containerID="5c68c465f7b65ed61a2762544095e091efd056215c5d2cc0770c1f79d322fc2f" exitCode=0 Jul 08 18:13:29.632859 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:29.632712 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" event={"ID":"311c5517-0910-4782-bd87-24e7f55ed00a","Type":"ContainerDied","Data":"5c68c465f7b65ed61a2762544095e091efd056215c5d2cc0770c1f79d322fc2f"} Jul 08 18:13:29.632859 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:29.632765 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" event={"ID":"311c5517-0910-4782-bd87-24e7f55ed00a","Type":"ContainerDied","Data":"810dc76994f5879d2e123d172db5434de0098f4743a731e68d9841c98c3d48e9"} Jul 08 18:13:29.632859 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:29.632717 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p" Jul 08 18:13:29.632859 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:29.632801 2552 scope.go:117] "RemoveContainer" containerID="5c68c465f7b65ed61a2762544095e091efd056215c5d2cc0770c1f79d322fc2f" Jul 08 18:13:29.642604 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:29.642580 2552 scope.go:117] "RemoveContainer" containerID="45212dbc7004de26b3d9229f7cbf40f2e839a864c6971651a4597ce471b227df" Jul 08 18:13:29.650860 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:29.650829 2552 scope.go:117] "RemoveContainer" containerID="5c68c465f7b65ed61a2762544095e091efd056215c5d2cc0770c1f79d322fc2f" Jul 08 18:13:29.651071 ip-10-0-130-38 kubenswrapper[2552]: E0708 18:13:29.651053 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c68c465f7b65ed61a2762544095e091efd056215c5d2cc0770c1f79d322fc2f\": container with ID starting with 5c68c465f7b65ed61a2762544095e091efd056215c5d2cc0770c1f79d322fc2f not found: ID does not exist" containerID="5c68c465f7b65ed61a2762544095e091efd056215c5d2cc0770c1f79d322fc2f" Jul 08 18:13:29.651122 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:29.651079 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c68c465f7b65ed61a2762544095e091efd056215c5d2cc0770c1f79d322fc2f"} err="failed to get container status \"5c68c465f7b65ed61a2762544095e091efd056215c5d2cc0770c1f79d322fc2f\": rpc error: code = NotFound desc = could not find container \"5c68c465f7b65ed61a2762544095e091efd056215c5d2cc0770c1f79d322fc2f\": container with ID starting with 5c68c465f7b65ed61a2762544095e091efd056215c5d2cc0770c1f79d322fc2f not found: ID does not exist" Jul 08 18:13:29.651122 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:29.651095 2552 scope.go:117] "RemoveContainer" containerID="45212dbc7004de26b3d9229f7cbf40f2e839a864c6971651a4597ce471b227df" Jul 08 18:13:29.651334 ip-10-0-130-38 kubenswrapper[2552]: E0708 18:13:29.651318 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45212dbc7004de26b3d9229f7cbf40f2e839a864c6971651a4597ce471b227df\": container with ID starting with 45212dbc7004de26b3d9229f7cbf40f2e839a864c6971651a4597ce471b227df not found: ID does not exist" containerID="45212dbc7004de26b3d9229f7cbf40f2e839a864c6971651a4597ce471b227df" Jul 08 18:13:29.651375 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:29.651338 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45212dbc7004de26b3d9229f7cbf40f2e839a864c6971651a4597ce471b227df"} err="failed to get container status \"45212dbc7004de26b3d9229f7cbf40f2e839a864c6971651a4597ce471b227df\": rpc error: code = NotFound desc = could not find container \"45212dbc7004de26b3d9229f7cbf40f2e839a864c6971651a4597ce471b227df\": container with ID starting with 45212dbc7004de26b3d9229f7cbf40f2e839a864c6971651a4597ce471b227df not found: ID does not exist" Jul 08 18:13:29.657782 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:29.657761 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p"] Jul 08 18:13:29.661667 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:29.661646 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-f4e475-openshift-default-676bbc784f-4vh8p"] Jul 08 18:13:30.306474 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:30.306442 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="311c5517-0910-4782-bd87-24e7f55ed00a" path="/var/lib/kubelet/pods/311c5517-0910-4782-bd87-24e7f55ed00a/volumes" Jul 08 18:13:30.770257 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:30.770229 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:30.833934 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:30.833890 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:31.047533 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:31.047444 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck"] Jul 08 18:13:31.047751 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:31.047723 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" podUID="ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca" containerName="istio-proxy" containerID="cri-o://d4b853cc430279690c90cd625fdfa3f02be370ec0c2f58c0fb4ae516d5ebd774" gracePeriod=30 Jul 08 18:13:31.076063 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:31.076039 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:31.638691 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:31.638658 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:31.971182 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:31.971144 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k"] Jul 08 18:13:31.971764 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:31.971747 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="311c5517-0910-4782-bd87-24e7f55ed00a" containerName="istio-proxy" Jul 08 18:13:31.971818 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:31.971769 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="311c5517-0910-4782-bd87-24e7f55ed00a" containerName="istio-proxy" Jul 08 18:13:31.971818 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:31.971802 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="311c5517-0910-4782-bd87-24e7f55ed00a" containerName="istio-proxy" Jul 08 18:13:31.971818 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:31.971810 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="311c5517-0910-4782-bd87-24e7f55ed00a" containerName="istio-proxy" Jul 08 18:13:31.971920 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:31.971890 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="311c5517-0910-4782-bd87-24e7f55ed00a" containerName="istio-proxy" Jul 08 18:13:31.975110 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:31.975090 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:31.977669 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:31.977651 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-f1c56e-openshift-default-dockercfg-bmb9t\"" Jul 08 18:13:31.987955 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:31.987934 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k"] Jul 08 18:13:32.003720 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.003693 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:32.074325 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.074294 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/839720af-fc9a-4dbf-b40d-5e48e7735026-workload-socket\") pod \"e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:32.074483 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.074336 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/839720af-fc9a-4dbf-b40d-5e48e7735026-istio-envoy\") pod \"e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:32.074483 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.074369 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/839720af-fc9a-4dbf-b40d-5e48e7735026-istiod-ca-cert\") pod \"e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:32.074589 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.074478 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmhdb\" (UniqueName: \"kubernetes.io/projected/839720af-fc9a-4dbf-b40d-5e48e7735026-kube-api-access-wmhdb\") pod \"e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:32.074589 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.074502 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/839720af-fc9a-4dbf-b40d-5e48e7735026-istio-podinfo\") pod \"e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:32.074589 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.074522 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/839720af-fc9a-4dbf-b40d-5e48e7735026-credential-socket\") pod \"e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:32.074589 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.074577 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/839720af-fc9a-4dbf-b40d-5e48e7735026-istio-data\") pod \"e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:32.074782 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.074670 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/839720af-fc9a-4dbf-b40d-5e48e7735026-istio-token\") pod \"e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:32.074782 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.074691 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/839720af-fc9a-4dbf-b40d-5e48e7735026-workload-certs\") pod \"e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:32.104270 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.104225 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:32.175321 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.175290 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmhdb\" (UniqueName: \"kubernetes.io/projected/839720af-fc9a-4dbf-b40d-5e48e7735026-kube-api-access-wmhdb\") pod \"e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:32.175321 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.175325 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/839720af-fc9a-4dbf-b40d-5e48e7735026-istio-podinfo\") pod \"e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:32.175598 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.175345 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/839720af-fc9a-4dbf-b40d-5e48e7735026-credential-socket\") pod \"e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:32.175598 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.175460 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/839720af-fc9a-4dbf-b40d-5e48e7735026-istio-data\") pod \"e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:32.175598 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.175500 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/839720af-fc9a-4dbf-b40d-5e48e7735026-istio-token\") pod \"e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:32.175598 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.175522 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/839720af-fc9a-4dbf-b40d-5e48e7735026-workload-certs\") pod \"e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:32.175598 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.175580 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/839720af-fc9a-4dbf-b40d-5e48e7735026-workload-socket\") pod \"e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:32.175863 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.175611 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/839720af-fc9a-4dbf-b40d-5e48e7735026-istio-envoy\") pod \"e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:32.175863 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.175643 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/839720af-fc9a-4dbf-b40d-5e48e7735026-istiod-ca-cert\") pod \"e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:32.175961 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.175944 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/839720af-fc9a-4dbf-b40d-5e48e7735026-credential-socket\") pod \"e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:32.176017 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.175984 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/839720af-fc9a-4dbf-b40d-5e48e7735026-workload-certs\") pod \"e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:32.176074 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.176041 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/839720af-fc9a-4dbf-b40d-5e48e7735026-istio-data\") pod \"e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:32.176117 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.176069 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/839720af-fc9a-4dbf-b40d-5e48e7735026-workload-socket\") pod \"e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:32.176333 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.176307 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/839720af-fc9a-4dbf-b40d-5e48e7735026-istiod-ca-cert\") pod \"e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:32.177921 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.177903 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/839720af-fc9a-4dbf-b40d-5e48e7735026-istio-podinfo\") pod \"e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:32.177978 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.177930 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/839720af-fc9a-4dbf-b40d-5e48e7735026-istio-envoy\") pod \"e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:32.183597 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.183571 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/839720af-fc9a-4dbf-b40d-5e48e7735026-istio-token\") pod \"e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:32.183763 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.183746 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmhdb\" (UniqueName: \"kubernetes.io/projected/839720af-fc9a-4dbf-b40d-5e48e7735026-kube-api-access-wmhdb\") pod \"e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:32.287050 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.286958 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:32.434782 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.434758 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k"] Jul 08 18:13:32.436953 ip-10-0-130-38 kubenswrapper[2552]: W0708 18:13:32.436922 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod839720af_fc9a_4dbf_b40d_5e48e7735026.slice/crio-0185f43db8d8229cdb148625d0eaeab85f723a1c5bdfc5217bdc0407567727db WatchSource:0}: Error finding container 0185f43db8d8229cdb148625d0eaeab85f723a1c5bdfc5217bdc0407567727db: Status 404 returned error can't find the container with id 0185f43db8d8229cdb148625d0eaeab85f723a1c5bdfc5217bdc0407567727db Jul 08 18:13:32.439130 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.439100 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:13:32.439202 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.439167 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:13:32.439202 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.439193 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:13:32.655246 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.655150 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" event={"ID":"839720af-fc9a-4dbf-b40d-5e48e7735026","Type":"ContainerStarted","Data":"eaa4e15bca60e3559bca4a7ef3770ca775ec3fe476c20567fdee0e537e3190b9"} Jul 08 18:13:32.655246 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.655240 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" event={"ID":"839720af-fc9a-4dbf-b40d-5e48e7735026","Type":"ContainerStarted","Data":"0185f43db8d8229cdb148625d0eaeab85f723a1c5bdfc5217bdc0407567727db"} Jul 08 18:13:32.676175 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:32.676130 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" podStartSLOduration=1.676114939 podStartE2EDuration="1.676114939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:13:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:13:32.674708337 +0000 UTC m=+2410.911100591" watchObservedRunningTime="2026-07-08 18:13:32.676114939 +0000 UTC m=+2410.912507242" Jul 08 18:13:33.287785 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:33.287747 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:33.293057 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:33.293033 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:33.661670 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:33.661578 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:33.662443 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:33.662424 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:34.620720 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:34.620657 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:34.722580 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:34.722521 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:34.850295 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:34.850252 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:35.439412 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:35.439379 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:35.581404 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:35.581377 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:36.305303 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.305269 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:36.414773 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.414674 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-workload-certs\") pod \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " Jul 08 18:13:36.414773 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.414722 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-istio-token\") pod \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " Jul 08 18:13:36.414773 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.414740 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-istio-envoy\") pod \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " Jul 08 18:13:36.414773 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.414768 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-workload-socket\") pod \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " Jul 08 18:13:36.415106 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.414833 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wv2zx\" (UniqueName: \"kubernetes.io/projected/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-kube-api-access-wv2zx\") pod \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " Jul 08 18:13:36.415106 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.414899 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-istio-podinfo\") pod \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " Jul 08 18:13:36.415106 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.414931 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-credential-socket\") pod \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " Jul 08 18:13:36.415106 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.414950 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-istiod-ca-cert\") pod \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " Jul 08 18:13:36.415106 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.415065 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-istio-data\") pod \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\" (UID: \"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca\") " Jul 08 18:13:36.415341 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.415102 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca" (UID: "ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:13:36.415341 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.415173 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca" (UID: "ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:13:36.415341 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.415290 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca" (UID: "ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:13:36.415572 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.415514 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca" (UID: "ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:13:36.415741 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.415651 2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-workload-certs\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:13:36.416035 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.416013 2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-workload-socket\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:13:36.416035 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.416039 2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-credential-socket\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:13:36.416308 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.416281 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-istio-data" (OuterVolumeSpecName: "istio-data") pod "ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca" (UID: "ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:13:36.417210 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.417181 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-istio-token" (OuterVolumeSpecName: "istio-token") pod "ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca" (UID: "ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:13:36.417358 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.417336 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca" (UID: "ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:13:36.417414 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.417393 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-kube-api-access-wv2zx" (OuterVolumeSpecName: "kube-api-access-wv2zx") pod "ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca" (UID: "ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca"). InnerVolumeSpecName "kube-api-access-wv2zx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:13:36.417463 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.417441 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca" (UID: "ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 18:13:36.517003 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.516975 2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-istio-data\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:13:36.517003 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.516999 2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-istio-token\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:13:36.517003 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.517008 2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-istio-envoy\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:13:36.517225 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.517016 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wv2zx\" (UniqueName: \"kubernetes.io/projected/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-kube-api-access-wv2zx\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:13:36.517225 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.517027 2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-istio-podinfo\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:13:36.517225 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.517035 2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca-istiod-ca-cert\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:13:36.679348 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.679251 2552 generic.go:356] "Generic (PLEG): container finished" podID="ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca" containerID="d4b853cc430279690c90cd625fdfa3f02be370ec0c2f58c0fb4ae516d5ebd774" exitCode=0 Jul 08 18:13:36.679348 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.679312 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" Jul 08 18:13:36.679623 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.679346 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" event={"ID":"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca","Type":"ContainerDied","Data":"d4b853cc430279690c90cd625fdfa3f02be370ec0c2f58c0fb4ae516d5ebd774"} Jul 08 18:13:36.679623 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.679439 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck" event={"ID":"ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca","Type":"ContainerDied","Data":"87db15a79c7826774562142abe68786ace8d3ec8876ac9ae310be0ba06f7a978"} Jul 08 18:13:36.679623 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.679470 2552 scope.go:117] "RemoveContainer" containerID="d4b853cc430279690c90cd625fdfa3f02be370ec0c2f58c0fb4ae516d5ebd774" Jul 08 18:13:36.689146 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.689045 2552 scope.go:117] "RemoveContainer" containerID="40f485ff4137a0687042d169bfe2f045da7e655078cc235d8ed96e8cae992f7e" Jul 08 18:13:36.697565 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.697532 2552 scope.go:117] "RemoveContainer" containerID="d4b853cc430279690c90cd625fdfa3f02be370ec0c2f58c0fb4ae516d5ebd774" Jul 08 18:13:36.697844 ip-10-0-130-38 kubenswrapper[2552]: E0708 18:13:36.697826 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4b853cc430279690c90cd625fdfa3f02be370ec0c2f58c0fb4ae516d5ebd774\": container with ID starting with d4b853cc430279690c90cd625fdfa3f02be370ec0c2f58c0fb4ae516d5ebd774 not found: ID does not exist" containerID="d4b853cc430279690c90cd625fdfa3f02be370ec0c2f58c0fb4ae516d5ebd774" Jul 08 18:13:36.697918 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.697860 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4b853cc430279690c90cd625fdfa3f02be370ec0c2f58c0fb4ae516d5ebd774"} err="failed to get container status \"d4b853cc430279690c90cd625fdfa3f02be370ec0c2f58c0fb4ae516d5ebd774\": rpc error: code = NotFound desc = could not find container \"d4b853cc430279690c90cd625fdfa3f02be370ec0c2f58c0fb4ae516d5ebd774\": container with ID starting with d4b853cc430279690c90cd625fdfa3f02be370ec0c2f58c0fb4ae516d5ebd774 not found: ID does not exist" Jul 08 18:13:36.697918 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.697885 2552 scope.go:117] "RemoveContainer" containerID="40f485ff4137a0687042d169bfe2f045da7e655078cc235d8ed96e8cae992f7e" Jul 08 18:13:36.698137 ip-10-0-130-38 kubenswrapper[2552]: E0708 18:13:36.698119 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40f485ff4137a0687042d169bfe2f045da7e655078cc235d8ed96e8cae992f7e\": container with ID starting with 40f485ff4137a0687042d169bfe2f045da7e655078cc235d8ed96e8cae992f7e not found: ID does not exist" containerID="40f485ff4137a0687042d169bfe2f045da7e655078cc235d8ed96e8cae992f7e" Jul 08 18:13:36.698190 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.698143 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40f485ff4137a0687042d169bfe2f045da7e655078cc235d8ed96e8cae992f7e"} err="failed to get container status \"40f485ff4137a0687042d169bfe2f045da7e655078cc235d8ed96e8cae992f7e\": rpc error: code = NotFound desc = could not find container \"40f485ff4137a0687042d169bfe2f045da7e655078cc235d8ed96e8cae992f7e\": container with ID starting with 40f485ff4137a0687042d169bfe2f045da7e655078cc235d8ed96e8cae992f7e not found: ID does not exist" Jul 08 18:13:36.704920 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.704891 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck"] Jul 08 18:13:36.709463 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:36.709442 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-761617-openshift-default-5dfd865b9c-nvrck"] Jul 08 18:13:38.306452 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:38.306420 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca" path="/var/lib/kubelet/pods/ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca/volumes" Jul 08 18:13:39.172850 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:39.172818 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:39.531694 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:39.531637 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:39.833453 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:39.833366 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp"] Jul 08 18:13:39.833789 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:39.833774 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca" containerName="istio-proxy" Jul 08 18:13:39.833842 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:39.833791 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca" containerName="istio-proxy" Jul 08 18:13:39.833842 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:39.833805 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca" containerName="istio-proxy" Jul 08 18:13:39.833842 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:39.833810 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca" containerName="istio-proxy" Jul 08 18:13:39.833953 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:39.833886 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="311c5517-0910-4782-bd87-24e7f55ed00a" containerName="istio-proxy" Jul 08 18:13:39.833953 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:39.833897 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca" containerName="istio-proxy" Jul 08 18:13:39.833953 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:39.833906 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae3b1821-b1a0-4ac9-a3e4-dc1983d66eca" containerName="istio-proxy" Jul 08 18:13:39.837782 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:39.837768 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:13:39.842342 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:39.842311 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-d5f862-openshift-default-dockercfg-2xm8m\"" Jul 08 18:13:39.853821 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:39.853799 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp"] Jul 08 18:13:39.870005 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:39.869984 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:39.950207 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:39.950173 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1983be7d-76cb-409e-8eca-460b1e934180-workload-socket\") pod \"e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:13:39.950397 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:39.950219 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1983be7d-76cb-409e-8eca-460b1e934180-istio-podinfo\") pod \"e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:13:39.950397 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:39.950246 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1983be7d-76cb-409e-8eca-460b1e934180-istiod-ca-cert\") pod \"e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:13:39.950397 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:39.950269 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7fbz\" (UniqueName: \"kubernetes.io/projected/1983be7d-76cb-409e-8eca-460b1e934180-kube-api-access-b7fbz\") pod \"e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:13:39.950397 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:39.950291 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1983be7d-76cb-409e-8eca-460b1e934180-workload-certs\") pod \"e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:13:39.950397 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:39.950368 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1983be7d-76cb-409e-8eca-460b1e934180-istio-token\") pod \"e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:13:39.950680 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:39.950460 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1983be7d-76cb-409e-8eca-460b1e934180-istio-envoy\") pod \"e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:13:39.950680 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:39.950493 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1983be7d-76cb-409e-8eca-460b1e934180-istio-data\") pod \"e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:13:39.950680 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:39.950572 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1983be7d-76cb-409e-8eca-460b1e934180-credential-socket\") pod \"e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:13:40.051672 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:40.051630 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1983be7d-76cb-409e-8eca-460b1e934180-credential-socket\") pod \"e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:13:40.051868 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:40.051706 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1983be7d-76cb-409e-8eca-460b1e934180-workload-socket\") pod \"e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:13:40.051868 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:40.051738 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1983be7d-76cb-409e-8eca-460b1e934180-istio-podinfo\") pod \"e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:13:40.051868 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:40.051769 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1983be7d-76cb-409e-8eca-460b1e934180-istiod-ca-cert\") pod \"e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:13:40.051868 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:40.051797 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7fbz\" (UniqueName: \"kubernetes.io/projected/1983be7d-76cb-409e-8eca-460b1e934180-kube-api-access-b7fbz\") pod \"e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:13:40.051868 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:40.051827 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1983be7d-76cb-409e-8eca-460b1e934180-workload-certs\") pod \"e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:13:40.051868 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:40.051864 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1983be7d-76cb-409e-8eca-460b1e934180-istio-token\") pod \"e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:13:40.052182 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:40.051930 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1983be7d-76cb-409e-8eca-460b1e934180-istio-envoy\") pod \"e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:13:40.052182 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:40.051962 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1983be7d-76cb-409e-8eca-460b1e934180-istio-data\") pod \"e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:13:40.052182 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:40.052085 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1983be7d-76cb-409e-8eca-460b1e934180-credential-socket\") pod \"e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:13:40.052182 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:40.052097 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1983be7d-76cb-409e-8eca-460b1e934180-workload-socket\") pod \"e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:13:40.052408 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:40.052191 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1983be7d-76cb-409e-8eca-460b1e934180-workload-certs\") pod \"e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:13:40.052466 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:40.052433 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1983be7d-76cb-409e-8eca-460b1e934180-istiod-ca-cert\") pod \"e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:13:40.052601 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:40.052581 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1983be7d-76cb-409e-8eca-460b1e934180-istio-data\") pod \"e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:13:40.054395 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:40.054374 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1983be7d-76cb-409e-8eca-460b1e934180-istio-envoy\") pod \"e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:13:40.054567 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:40.054530 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1983be7d-76cb-409e-8eca-460b1e934180-istio-podinfo\") pod \"e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:13:40.060295 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:40.060265 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1983be7d-76cb-409e-8eca-460b1e934180-istio-token\") pod \"e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:13:40.060421 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:40.060410 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7fbz\" (UniqueName: \"kubernetes.io/projected/1983be7d-76cb-409e-8eca-460b1e934180-kube-api-access-b7fbz\") pod \"e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:13:40.148386 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:40.148293 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:13:40.291233 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:40.291204 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp"] Jul 08 18:13:40.292548 ip-10-0-130-38 kubenswrapper[2552]: W0708 18:13:40.292511 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1983be7d_76cb_409e_8eca_460b1e934180.slice/crio-aeedfa2903f5915fc28e659ffcecf3a6ad111975b8bbac0db431998dbfa199ec WatchSource:0}: Error finding container aeedfa2903f5915fc28e659ffcecf3a6ad111975b8bbac0db431998dbfa199ec: Status 404 returned error can't find the container with id aeedfa2903f5915fc28e659ffcecf3a6ad111975b8bbac0db431998dbfa199ec Jul 08 18:13:40.294686 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:40.294654 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:13:40.294754 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:40.294722 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:13:40.294754 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:40.294750 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:13:40.316623 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:40.316600 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:40.701275 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:40.701239 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" event={"ID":"1983be7d-76cb-409e-8eca-460b1e934180","Type":"ContainerStarted","Data":"07a7f78936e43e1c970e839d847ba0fd0e6aa6402e3bd415c37a04667f2987dd"} Jul 08 18:13:40.701699 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:40.701301 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" event={"ID":"1983be7d-76cb-409e-8eca-460b1e934180","Type":"ContainerStarted","Data":"aeedfa2903f5915fc28e659ffcecf3a6ad111975b8bbac0db431998dbfa199ec"} Jul 08 18:13:41.149112 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:41.149033 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:13:41.154637 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:41.154612 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:13:41.182446 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:41.182395 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" podStartSLOduration=2.182375487 podStartE2EDuration="2.182375487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:13:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:13:40.735345567 +0000 UTC m=+2418.971737833" watchObservedRunningTime="2026-07-08 18:13:41.182375487 +0000 UTC m=+2419.418767742" Jul 08 18:13:41.706140 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:41.706111 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:13:41.707185 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:41.707167 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:13:42.800101 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:42.800070 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:42.895979 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:42.895948 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:43.066052 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:43.065964 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:43.406433 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:43.406323 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:43.609315 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:43.609269 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:43.709979 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:43.709944 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:47.330240 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:47.330196 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:48.663195 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:48.663158 2552 patch_prober.go:28] interesting pod/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 08 18:13:48.663764 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:48.663220 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" podUID="839720af-fc9a-4dbf-b40d-5e48e7735026" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 08 18:13:48.751597 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:48.751562 2552 generic.go:356] "Generic (PLEG): container finished" podID="839720af-fc9a-4dbf-b40d-5e48e7735026" containerID="eaa4e15bca60e3559bca4a7ef3770ca775ec3fe476c20567fdee0e537e3190b9" exitCode=0 Jul 08 18:13:48.751775 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:48.751615 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" event={"ID":"839720af-fc9a-4dbf-b40d-5e48e7735026","Type":"ContainerDied","Data":"eaa4e15bca60e3559bca4a7ef3770ca775ec3fe476c20567fdee0e537e3190b9"} Jul 08 18:13:48.752090 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:48.752072 2552 scope.go:117] "RemoveContainer" containerID="eaa4e15bca60e3559bca4a7ef3770ca775ec3fe476c20567fdee0e537e3190b9" Jul 08 18:13:48.753168 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:48.753140 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:13:48.753246 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:48.753228 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:13:48.753311 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:48.753295 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:13:49.763132 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:49.763079 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" event={"ID":"839720af-fc9a-4dbf-b40d-5e48e7735026","Type":"ContainerStarted","Data":"27c08ea9da6be6003d63cd3cd6b295f9853f1b6e11fd1710fcd4e3ca4e988e2d"} Jul 08 18:13:50.287579 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:50.287523 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:50.287789 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:50.287661 2552 patch_prober.go:28] interesting pod/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 08 18:13:50.287789 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:50.287711 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" podUID="839720af-fc9a-4dbf-b40d-5e48e7735026" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 08 18:13:51.287407 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:51.287366 2552 patch_prober.go:28] interesting pod/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 08 18:13:51.287829 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:51.287423 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" podUID="839720af-fc9a-4dbf-b40d-5e48e7735026" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 08 18:13:52.287380 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:52.287339 2552 patch_prober.go:28] interesting pod/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 08 18:13:52.287554 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:52.287415 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" podUID="839720af-fc9a-4dbf-b40d-5e48e7735026" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 08 18:13:53.288196 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:53.288162 2552 patch_prober.go:28] interesting pod/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body= Jul 08 18:13:53.288615 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:53.288214 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" podUID="839720af-fc9a-4dbf-b40d-5e48e7735026" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" Jul 08 18:13:54.292759 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:54.292722 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:54.293244 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:54.293078 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:54.293831 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:54.293813 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:13:56.171314 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:56.171219 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:56.270373 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:56.270346 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:13:56.707767 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:56.707729 2552 patch_prober.go:28] interesting pod/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 08 18:13:56.707951 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:56.707788 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" podUID="1983be7d-76cb-409e-8eca-460b1e934180" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 08 18:13:56.806019 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:56.805987 2552 generic.go:356] "Generic (PLEG): container finished" podID="1983be7d-76cb-409e-8eca-460b1e934180" containerID="07a7f78936e43e1c970e839d847ba0fd0e6aa6402e3bd415c37a04667f2987dd" exitCode=0 Jul 08 18:13:56.806210 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:56.806058 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" event={"ID":"1983be7d-76cb-409e-8eca-460b1e934180","Type":"ContainerDied","Data":"07a7f78936e43e1c970e839d847ba0fd0e6aa6402e3bd415c37a04667f2987dd"} Jul 08 18:13:56.806483 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:56.806469 2552 scope.go:117] "RemoveContainer" containerID="07a7f78936e43e1c970e839d847ba0fd0e6aa6402e3bd415c37a04667f2987dd" Jul 08 18:13:56.807498 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:56.807471 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:13:56.807564 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:56.807552 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:13:56.807605 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:56.807593 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 18:13:57.813230 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:57.813187 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" event={"ID":"1983be7d-76cb-409e-8eca-460b1e934180","Type":"ContainerStarted","Data":"5461ed28176b30059cfce65b7b870541ff67e6f04317ef173dd0d29236204a31"} Jul 08 18:13:58.149391 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:58.149297 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:13:58.149565 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:58.149509 2552 patch_prober.go:28] interesting pod/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 08 18:13:58.149612 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:58.149578 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" podUID="1983be7d-76cb-409e-8eca-460b1e934180" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 08 18:13:59.150045 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:59.149999 2552 patch_prober.go:28] interesting pod/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 08 18:13:59.150602 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:13:59.150070 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" podUID="1983be7d-76cb-409e-8eca-460b1e934180" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 08 18:14:00.149482 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:14:00.149441 2552 patch_prober.go:28] interesting pod/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 08 18:14:00.149698 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:14:00.149508 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" podUID="1983be7d-76cb-409e-8eca-460b1e934180" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 08 18:14:01.149347 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:14:01.149312 2552 patch_prober.go:28] interesting pod/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 08 18:14:01.149786 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:14:01.149370 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" podUID="1983be7d-76cb-409e-8eca-460b1e934180" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 08 18:14:02.149604 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:14:02.149560 2552 patch_prober.go:28] interesting pod/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 08 18:14:02.150090 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:14:02.149622 2552 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" podUID="1983be7d-76cb-409e-8eca-460b1e934180" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 08 18:14:03.152616 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:14:03.152582 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:14:03.153043 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:14:03.152969 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:14:03.153710 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:14:03.153693 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:14:04.376428 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:14:04.376393 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:14:04.476784 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:14:04.476747 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:14:26.527824 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:14:26.527787 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:14:27.787922 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:14:27.787882 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:15:50.146226 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:15:50.146140 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:16:52.188840 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:16:52.188762 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:16:52.579714 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:16:52.579668 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:16:52.698500 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:16:52.698466 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:16:52.798256 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:16:52.798227 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:16:52.899960 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:16:52.899876 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:16:58.961221 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:16:58.961182 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:16:59.061683 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:16:59.061653 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:16:59.208265 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:16:59.208231 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k"] Jul 08 18:16:59.208522 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:16:59.208499 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" podUID="839720af-fc9a-4dbf-b40d-5e48e7735026" containerName="istio-proxy" containerID="cri-o://27c08ea9da6be6003d63cd3cd6b295f9853f1b6e11fd1710fcd4e3ca4e988e2d" gracePeriod=30 Jul 08 18:16:59.251212 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:16:59.251129 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:16:59.627450 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:16:59.627360 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:17:00.030176 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:00.030113 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:17:00.243862 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:00.243827 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:17:00.342607 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:00.342482 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:17:00.493801 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:00.493768 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:17:04.465656 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.465630 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:17:04.633724 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.633639 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/839720af-fc9a-4dbf-b40d-5e48e7735026-istiod-ca-cert\") pod \"839720af-fc9a-4dbf-b40d-5e48e7735026\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " Jul 08 18:17:04.633724 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.633688 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/839720af-fc9a-4dbf-b40d-5e48e7735026-istio-data\") pod \"839720af-fc9a-4dbf-b40d-5e48e7735026\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " Jul 08 18:17:04.633938 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.633737 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmhdb\" (UniqueName: \"kubernetes.io/projected/839720af-fc9a-4dbf-b40d-5e48e7735026-kube-api-access-wmhdb\") pod \"839720af-fc9a-4dbf-b40d-5e48e7735026\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " Jul 08 18:17:04.633938 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.633778 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/839720af-fc9a-4dbf-b40d-5e48e7735026-istio-podinfo\") pod \"839720af-fc9a-4dbf-b40d-5e48e7735026\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " Jul 08 18:17:04.633938 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.633822 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/839720af-fc9a-4dbf-b40d-5e48e7735026-credential-socket\") pod \"839720af-fc9a-4dbf-b40d-5e48e7735026\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " Jul 08 18:17:04.634098 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.633934 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/839720af-fc9a-4dbf-b40d-5e48e7735026-workload-certs\") pod \"839720af-fc9a-4dbf-b40d-5e48e7735026\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " Jul 08 18:17:04.634098 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.633976 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/839720af-fc9a-4dbf-b40d-5e48e7735026-workload-socket\") pod \"839720af-fc9a-4dbf-b40d-5e48e7735026\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " Jul 08 18:17:04.634098 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.634028 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/839720af-fc9a-4dbf-b40d-5e48e7735026-istio-envoy\") pod \"839720af-fc9a-4dbf-b40d-5e48e7735026\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " Jul 08 18:17:04.634098 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.634073 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/839720af-fc9a-4dbf-b40d-5e48e7735026-istio-token\") pod \"839720af-fc9a-4dbf-b40d-5e48e7735026\" (UID: \"839720af-fc9a-4dbf-b40d-5e48e7735026\") " Jul 08 18:17:04.634305 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.634112 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/839720af-fc9a-4dbf-b40d-5e48e7735026-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "839720af-fc9a-4dbf-b40d-5e48e7735026" (UID: "839720af-fc9a-4dbf-b40d-5e48e7735026"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:17:04.634305 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.634149 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/839720af-fc9a-4dbf-b40d-5e48e7735026-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "839720af-fc9a-4dbf-b40d-5e48e7735026" (UID: "839720af-fc9a-4dbf-b40d-5e48e7735026"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:17:04.634305 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.634208 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/839720af-fc9a-4dbf-b40d-5e48e7735026-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "839720af-fc9a-4dbf-b40d-5e48e7735026" (UID: "839720af-fc9a-4dbf-b40d-5e48e7735026"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:17:04.634471 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.634354 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/839720af-fc9a-4dbf-b40d-5e48e7735026-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "839720af-fc9a-4dbf-b40d-5e48e7735026" (UID: "839720af-fc9a-4dbf-b40d-5e48e7735026"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:17:04.634471 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.634460 2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/839720af-fc9a-4dbf-b40d-5e48e7735026-istiod-ca-cert\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:17:04.634614 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.634483 2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/839720af-fc9a-4dbf-b40d-5e48e7735026-credential-socket\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:17:04.634614 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.634501 2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/839720af-fc9a-4dbf-b40d-5e48e7735026-workload-certs\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:17:04.634614 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.634513 2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/839720af-fc9a-4dbf-b40d-5e48e7735026-workload-socket\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:17:04.634950 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.634900 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/839720af-fc9a-4dbf-b40d-5e48e7735026-istio-data" (OuterVolumeSpecName: "istio-data") pod "839720af-fc9a-4dbf-b40d-5e48e7735026" (UID: "839720af-fc9a-4dbf-b40d-5e48e7735026"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:17:04.636223 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.636201 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/839720af-fc9a-4dbf-b40d-5e48e7735026-kube-api-access-wmhdb" (OuterVolumeSpecName: "kube-api-access-wmhdb") pod "839720af-fc9a-4dbf-b40d-5e48e7735026" (UID: "839720af-fc9a-4dbf-b40d-5e48e7735026"). InnerVolumeSpecName "kube-api-access-wmhdb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:17:04.636373 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.636356 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/839720af-fc9a-4dbf-b40d-5e48e7735026-istio-token" (OuterVolumeSpecName: "istio-token") pod "839720af-fc9a-4dbf-b40d-5e48e7735026" (UID: "839720af-fc9a-4dbf-b40d-5e48e7735026"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:17:04.636820 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.636794 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/839720af-fc9a-4dbf-b40d-5e48e7735026-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "839720af-fc9a-4dbf-b40d-5e48e7735026" (UID: "839720af-fc9a-4dbf-b40d-5e48e7735026"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:17:04.636820 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.636804 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/839720af-fc9a-4dbf-b40d-5e48e7735026-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "839720af-fc9a-4dbf-b40d-5e48e7735026" (UID: "839720af-fc9a-4dbf-b40d-5e48e7735026"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 18:17:04.735782 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.735744 2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/839720af-fc9a-4dbf-b40d-5e48e7735026-istio-envoy\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:17:04.735782 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.735773 2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/839720af-fc9a-4dbf-b40d-5e48e7735026-istio-token\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:17:04.735782 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.735782 2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/839720af-fc9a-4dbf-b40d-5e48e7735026-istio-data\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:17:04.735782 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.735791 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmhdb\" (UniqueName: \"kubernetes.io/projected/839720af-fc9a-4dbf-b40d-5e48e7735026-kube-api-access-wmhdb\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:17:04.736133 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.735801 2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/839720af-fc9a-4dbf-b40d-5e48e7735026-istio-podinfo\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:17:04.817030 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.816998 2552 generic.go:356] "Generic (PLEG): container finished" podID="839720af-fc9a-4dbf-b40d-5e48e7735026" containerID="27c08ea9da6be6003d63cd3cd6b295f9853f1b6e11fd1710fcd4e3ca4e988e2d" exitCode=0 Jul 08 18:17:04.817201 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.817037 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" event={"ID":"839720af-fc9a-4dbf-b40d-5e48e7735026","Type":"ContainerDied","Data":"27c08ea9da6be6003d63cd3cd6b295f9853f1b6e11fd1710fcd4e3ca4e988e2d"} Jul 08 18:17:04.817201 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.817050 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" Jul 08 18:17:04.817201 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.817079 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k" event={"ID":"839720af-fc9a-4dbf-b40d-5e48e7735026","Type":"ContainerDied","Data":"0185f43db8d8229cdb148625d0eaeab85f723a1c5bdfc5217bdc0407567727db"} Jul 08 18:17:04.817201 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.817100 2552 scope.go:117] "RemoveContainer" containerID="27c08ea9da6be6003d63cd3cd6b295f9853f1b6e11fd1710fcd4e3ca4e988e2d" Jul 08 18:17:04.827722 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.827703 2552 scope.go:117] "RemoveContainer" containerID="eaa4e15bca60e3559bca4a7ef3770ca775ec3fe476c20567fdee0e537e3190b9" Jul 08 18:17:04.836252 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.836233 2552 scope.go:117] "RemoveContainer" containerID="27c08ea9da6be6003d63cd3cd6b295f9853f1b6e11fd1710fcd4e3ca4e988e2d" Jul 08 18:17:04.836661 ip-10-0-130-38 kubenswrapper[2552]: E0708 18:17:04.836629 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27c08ea9da6be6003d63cd3cd6b295f9853f1b6e11fd1710fcd4e3ca4e988e2d\": container with ID starting with 27c08ea9da6be6003d63cd3cd6b295f9853f1b6e11fd1710fcd4e3ca4e988e2d not found: ID does not exist" containerID="27c08ea9da6be6003d63cd3cd6b295f9853f1b6e11fd1710fcd4e3ca4e988e2d" Jul 08 18:17:04.836761 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.836660 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27c08ea9da6be6003d63cd3cd6b295f9853f1b6e11fd1710fcd4e3ca4e988e2d"} err="failed to get container status \"27c08ea9da6be6003d63cd3cd6b295f9853f1b6e11fd1710fcd4e3ca4e988e2d\": rpc error: code = NotFound desc = could not find container \"27c08ea9da6be6003d63cd3cd6b295f9853f1b6e11fd1710fcd4e3ca4e988e2d\": container with ID starting with 27c08ea9da6be6003d63cd3cd6b295f9853f1b6e11fd1710fcd4e3ca4e988e2d not found: ID does not exist" Jul 08 18:17:04.836761 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.836677 2552 scope.go:117] "RemoveContainer" containerID="eaa4e15bca60e3559bca4a7ef3770ca775ec3fe476c20567fdee0e537e3190b9" Jul 08 18:17:04.836908 ip-10-0-130-38 kubenswrapper[2552]: E0708 18:17:04.836891 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eaa4e15bca60e3559bca4a7ef3770ca775ec3fe476c20567fdee0e537e3190b9\": container with ID starting with eaa4e15bca60e3559bca4a7ef3770ca775ec3fe476c20567fdee0e537e3190b9 not found: ID does not exist" containerID="eaa4e15bca60e3559bca4a7ef3770ca775ec3fe476c20567fdee0e537e3190b9" Jul 08 18:17:04.836964 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.836912 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaa4e15bca60e3559bca4a7ef3770ca775ec3fe476c20567fdee0e537e3190b9"} err="failed to get container status \"eaa4e15bca60e3559bca4a7ef3770ca775ec3fe476c20567fdee0e537e3190b9\": rpc error: code = NotFound desc = could not find container \"eaa4e15bca60e3559bca4a7ef3770ca775ec3fe476c20567fdee0e537e3190b9\": container with ID starting with eaa4e15bca60e3559bca4a7ef3770ca775ec3fe476c20567fdee0e537e3190b9 not found: ID does not exist" Jul 08 18:17:04.840950 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.840927 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k"] Jul 08 18:17:04.846226 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:04.846201 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-f1c56e-openshift-default-8668cb8df9-nwg9k"] Jul 08 18:17:06.151392 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:06.151352 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:17:06.220804 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:06.220747 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:17:06.306679 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:06.306648 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="839720af-fc9a-4dbf-b40d-5e48e7735026" path="/var/lib/kubelet/pods/839720af-fc9a-4dbf-b40d-5e48e7735026/volumes" Jul 08 18:17:06.417835 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:06.417751 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp"] Jul 08 18:17:06.417982 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:06.417963 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" podUID="1983be7d-76cb-409e-8eca-460b1e934180" containerName="istio-proxy" containerID="cri-o://5461ed28176b30059cfce65b7b870541ff67e6f04317ef173dd0d29236204a31" gracePeriod=30 Jul 08 18:17:06.435377 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:06.435350 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:17:07.204822 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:07.204792 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-bc745d9c6-nlc68_d18b6dd5-5528-44b3-b43f-332d6f5d753a/authorino/0.log" Jul 08 18:17:11.667722 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.667698 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:17:11.804707 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.804667 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1983be7d-76cb-409e-8eca-460b1e934180-workload-certs\") pod \"1983be7d-76cb-409e-8eca-460b1e934180\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " Jul 08 18:17:11.804707 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.804710 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1983be7d-76cb-409e-8eca-460b1e934180-istio-token\") pod \"1983be7d-76cb-409e-8eca-460b1e934180\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " Jul 08 18:17:11.804967 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.804746 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1983be7d-76cb-409e-8eca-460b1e934180-credential-socket\") pod \"1983be7d-76cb-409e-8eca-460b1e934180\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " Jul 08 18:17:11.804967 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.804840 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1983be7d-76cb-409e-8eca-460b1e934180-istio-podinfo\") pod \"1983be7d-76cb-409e-8eca-460b1e934180\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " Jul 08 18:17:11.804967 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.804865 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1983be7d-76cb-409e-8eca-460b1e934180-istio-data\") pod \"1983be7d-76cb-409e-8eca-460b1e934180\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " Jul 08 18:17:11.804967 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.804890 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7fbz\" (UniqueName: \"kubernetes.io/projected/1983be7d-76cb-409e-8eca-460b1e934180-kube-api-access-b7fbz\") pod \"1983be7d-76cb-409e-8eca-460b1e934180\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " Jul 08 18:17:11.804967 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.804914 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1983be7d-76cb-409e-8eca-460b1e934180-workload-socket\") pod \"1983be7d-76cb-409e-8eca-460b1e934180\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " Jul 08 18:17:11.804967 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.804944 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1983be7d-76cb-409e-8eca-460b1e934180-istiod-ca-cert\") pod \"1983be7d-76cb-409e-8eca-460b1e934180\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " Jul 08 18:17:11.805260 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.804984 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1983be7d-76cb-409e-8eca-460b1e934180-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1983be7d-76cb-409e-8eca-460b1e934180" (UID: "1983be7d-76cb-409e-8eca-460b1e934180"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:17:11.805260 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.805008 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1983be7d-76cb-409e-8eca-460b1e934180-istio-envoy\") pod \"1983be7d-76cb-409e-8eca-460b1e934180\" (UID: \"1983be7d-76cb-409e-8eca-460b1e934180\") " Jul 08 18:17:11.805359 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.805279 2552 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1983be7d-76cb-409e-8eca-460b1e934180-workload-certs\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:17:11.805359 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.805294 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1983be7d-76cb-409e-8eca-460b1e934180-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1983be7d-76cb-409e-8eca-460b1e934180" (UID: "1983be7d-76cb-409e-8eca-460b1e934180"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:17:11.805359 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.805316 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1983be7d-76cb-409e-8eca-460b1e934180-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1983be7d-76cb-409e-8eca-460b1e934180" (UID: "1983be7d-76cb-409e-8eca-460b1e934180"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 18:17:11.805861 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.805774 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1983be7d-76cb-409e-8eca-460b1e934180-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1983be7d-76cb-409e-8eca-460b1e934180" (UID: "1983be7d-76cb-409e-8eca-460b1e934180"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:17:11.806114 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.806083 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1983be7d-76cb-409e-8eca-460b1e934180-istio-data" (OuterVolumeSpecName: "istio-data") pod "1983be7d-76cb-409e-8eca-460b1e934180" (UID: "1983be7d-76cb-409e-8eca-460b1e934180"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:17:11.807221 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.807188 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1983be7d-76cb-409e-8eca-460b1e934180-istio-token" (OuterVolumeSpecName: "istio-token") pod "1983be7d-76cb-409e-8eca-460b1e934180" (UID: "1983be7d-76cb-409e-8eca-460b1e934180"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:17:11.807221 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.807206 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1983be7d-76cb-409e-8eca-460b1e934180-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1983be7d-76cb-409e-8eca-460b1e934180" (UID: "1983be7d-76cb-409e-8eca-460b1e934180"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 18:17:11.807221 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.807188 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1983be7d-76cb-409e-8eca-460b1e934180-kube-api-access-b7fbz" (OuterVolumeSpecName: "kube-api-access-b7fbz") pod "1983be7d-76cb-409e-8eca-460b1e934180" (UID: "1983be7d-76cb-409e-8eca-460b1e934180"). InnerVolumeSpecName "kube-api-access-b7fbz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 18:17:11.807470 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.807456 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1983be7d-76cb-409e-8eca-460b1e934180-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1983be7d-76cb-409e-8eca-460b1e934180" (UID: "1983be7d-76cb-409e-8eca-460b1e934180"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 18:17:11.855989 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.855954 2552 generic.go:356] "Generic (PLEG): container finished" podID="1983be7d-76cb-409e-8eca-460b1e934180" containerID="5461ed28176b30059cfce65b7b870541ff67e6f04317ef173dd0d29236204a31" exitCode=0 Jul 08 18:17:11.856184 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.856022 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" Jul 08 18:17:11.856184 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.856042 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" event={"ID":"1983be7d-76cb-409e-8eca-460b1e934180","Type":"ContainerDied","Data":"5461ed28176b30059cfce65b7b870541ff67e6f04317ef173dd0d29236204a31"} Jul 08 18:17:11.856184 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.856155 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp" event={"ID":"1983be7d-76cb-409e-8eca-460b1e934180","Type":"ContainerDied","Data":"aeedfa2903f5915fc28e659ffcecf3a6ad111975b8bbac0db431998dbfa199ec"} Jul 08 18:17:11.856184 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.856184 2552 scope.go:117] "RemoveContainer" containerID="5461ed28176b30059cfce65b7b870541ff67e6f04317ef173dd0d29236204a31" Jul 08 18:17:11.866155 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.866137 2552 scope.go:117] "RemoveContainer" containerID="07a7f78936e43e1c970e839d847ba0fd0e6aa6402e3bd415c37a04667f2987dd" Jul 08 18:17:11.875409 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.875390 2552 scope.go:117] "RemoveContainer" containerID="5461ed28176b30059cfce65b7b870541ff67e6f04317ef173dd0d29236204a31" Jul 08 18:17:11.875693 ip-10-0-130-38 kubenswrapper[2552]: E0708 18:17:11.875672 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5461ed28176b30059cfce65b7b870541ff67e6f04317ef173dd0d29236204a31\": container with ID starting with 5461ed28176b30059cfce65b7b870541ff67e6f04317ef173dd0d29236204a31 not found: ID does not exist" containerID="5461ed28176b30059cfce65b7b870541ff67e6f04317ef173dd0d29236204a31" Jul 08 18:17:11.875778 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.875702 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5461ed28176b30059cfce65b7b870541ff67e6f04317ef173dd0d29236204a31"} err="failed to get container status \"5461ed28176b30059cfce65b7b870541ff67e6f04317ef173dd0d29236204a31\": rpc error: code = NotFound desc = could not find container \"5461ed28176b30059cfce65b7b870541ff67e6f04317ef173dd0d29236204a31\": container with ID starting with 5461ed28176b30059cfce65b7b870541ff67e6f04317ef173dd0d29236204a31 not found: ID does not exist" Jul 08 18:17:11.875778 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.875719 2552 scope.go:117] "RemoveContainer" containerID="07a7f78936e43e1c970e839d847ba0fd0e6aa6402e3bd415c37a04667f2987dd" Jul 08 18:17:11.875962 ip-10-0-130-38 kubenswrapper[2552]: E0708 18:17:11.875948 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07a7f78936e43e1c970e839d847ba0fd0e6aa6402e3bd415c37a04667f2987dd\": container with ID starting with 07a7f78936e43e1c970e839d847ba0fd0e6aa6402e3bd415c37a04667f2987dd not found: ID does not exist" containerID="07a7f78936e43e1c970e839d847ba0fd0e6aa6402e3bd415c37a04667f2987dd" Jul 08 18:17:11.876006 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.875965 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07a7f78936e43e1c970e839d847ba0fd0e6aa6402e3bd415c37a04667f2987dd"} err="failed to get container status \"07a7f78936e43e1c970e839d847ba0fd0e6aa6402e3bd415c37a04667f2987dd\": rpc error: code = NotFound desc = could not find container \"07a7f78936e43e1c970e839d847ba0fd0e6aa6402e3bd415c37a04667f2987dd\": container with ID starting with 07a7f78936e43e1c970e839d847ba0fd0e6aa6402e3bd415c37a04667f2987dd not found: ID does not exist" Jul 08 18:17:11.879777 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.879752 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp"] Jul 08 18:17:11.883822 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.883799 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-d5f862-openshift-default-795dbd49f5-c79mp"] Jul 08 18:17:11.906130 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.906097 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7fbz\" (UniqueName: \"kubernetes.io/projected/1983be7d-76cb-409e-8eca-460b1e934180-kube-api-access-b7fbz\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:17:11.906130 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.906126 2552 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1983be7d-76cb-409e-8eca-460b1e934180-workload-socket\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:17:11.906130 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.906135 2552 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1983be7d-76cb-409e-8eca-460b1e934180-istiod-ca-cert\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:17:11.906332 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.906147 2552 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1983be7d-76cb-409e-8eca-460b1e934180-istio-envoy\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:17:11.906332 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.906160 2552 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1983be7d-76cb-409e-8eca-460b1e934180-istio-token\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:17:11.906332 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.906168 2552 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1983be7d-76cb-409e-8eca-460b1e934180-credential-socket\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:17:11.906332 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.906176 2552 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1983be7d-76cb-409e-8eca-460b1e934180-istio-podinfo\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:17:11.906332 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:11.906184 2552 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1983be7d-76cb-409e-8eca-460b1e934180-istio-data\") on node \"ip-10-0-130-38.ec2.internal\" DevicePath \"\"" Jul 08 18:17:12.307819 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:12.307789 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1983be7d-76cb-409e-8eca-460b1e934180" path="/var/lib/kubelet/pods/1983be7d-76cb-409e-8eca-460b1e934180/volumes" Jul 08 18:17:12.330329 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:12.330306 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b7dd476c8-j64gq_7dcd03aa-f58a-4c4e-bad6-186f0f72e41b/copy-manifests/0.log" Jul 08 18:17:12.337449 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:12.337426 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b7dd476c8-j64gq_7dcd03aa-f58a-4c4e-bad6-186f0f72e41b/manager/0.log" Jul 08 18:17:13.209039 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:13.209011 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd_28b489c6-2209-4551-9b1a-9708251da0ff/util/0.log" Jul 08 18:17:13.214850 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:13.214830 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd_28b489c6-2209-4551-9b1a-9708251da0ff/pull/0.log" Jul 08 18:17:13.220893 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:13.220877 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd_28b489c6-2209-4551-9b1a-9708251da0ff/extract/0.log" Jul 08 18:17:13.333452 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:13.333426 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz_4da1d754-e7b9-440d-a83f-cc2eb4df56c0/pull/0.log" Jul 08 18:17:13.339769 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:13.339725 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz_4da1d754-e7b9-440d-a83f-cc2eb4df56c0/extract/0.log" Jul 08 18:17:13.345721 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:13.345700 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz_4da1d754-e7b9-440d-a83f-cc2eb4df56c0/util/0.log" Jul 08 18:17:13.454994 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:13.454970 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz_3c7c90ea-47a9-460f-8207-8f64130b9a96/util/0.log" Jul 08 18:17:13.461290 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:13.461233 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz_3c7c90ea-47a9-460f-8207-8f64130b9a96/pull/0.log" Jul 08 18:17:13.467029 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:13.467011 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz_3c7c90ea-47a9-460f-8207-8f64130b9a96/extract/0.log" Jul 08 18:17:13.573388 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:13.573366 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q_76a09a05-b454-46ed-9250-69e07de573f8/util/0.log" Jul 08 18:17:13.579991 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:13.579973 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q_76a09a05-b454-46ed-9250-69e07de573f8/pull/0.log" Jul 08 18:17:13.586371 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:13.586356 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q_76a09a05-b454-46ed-9250-69e07de573f8/extract/0.log" Jul 08 18:17:13.696650 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:13.696625 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-bc745d9c6-nlc68_d18b6dd5-5528-44b3-b43f-332d6f5d753a/authorino/0.log" Jul 08 18:17:13.806595 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:13.806511 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-g59th_66a40a61-8cdb-4172-bcde-baab112536f2/manager/0.log" Jul 08 18:17:14.025413 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:14.025385 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-x4rg4_64c1ad54-5e1e-44b3-9cc5-fdd94ee0677b/kuadrant-console-plugin/0.log" Jul 08 18:17:14.138409 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:14.138335 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zck7m_495aa8a3-5e15-44d5-88d1-da9aa34e8f50/registry-server/0.log" Jul 08 18:17:14.256782 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:14.256753 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-vgm8b_bccd334a-41a0-4757-8bef-0580f71a02cc/manager/0.log" Jul 08 18:17:14.833503 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:14.833469 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf457j8k_6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a/istio-proxy/0.log" Jul 08 18:17:15.386184 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:15.386141 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-ns4kf_2378db08-f17a-4cf9-8071-418c81fc9665/payload-pre-processing/0.log" Jul 08 18:17:15.609564 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:15.609519 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-cb559779c-fbv6t_eba717c9-222d-4dcf-a495-4e79977b5a93/router/0.log" Jul 08 18:17:16.057637 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:16.057609 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-5q5xz_98cd9a43-e0ce-40d6-aa68-248427e45089/main/0.log" Jul 08 18:17:16.282810 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:16.282782 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db4vpkx_e9200d9d-2d2b-42f1-ba45-00137f5aa113/main/0.log" Jul 08 18:17:20.381620 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:20.381566 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vzqzv/must-gather-sxz76"] Jul 08 18:17:20.382095 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:20.382073 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="839720af-fc9a-4dbf-b40d-5e48e7735026" containerName="istio-proxy" Jul 08 18:17:20.382177 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:20.382100 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="839720af-fc9a-4dbf-b40d-5e48e7735026" containerName="istio-proxy" Jul 08 18:17:20.382177 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:20.382111 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1983be7d-76cb-409e-8eca-460b1e934180" containerName="istio-proxy" Jul 08 18:17:20.382177 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:20.382119 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="1983be7d-76cb-409e-8eca-460b1e934180" containerName="istio-proxy" Jul 08 18:17:20.382177 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:20.382149 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1983be7d-76cb-409e-8eca-460b1e934180" containerName="istio-proxy" Jul 08 18:17:20.382177 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:20.382158 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="1983be7d-76cb-409e-8eca-460b1e934180" containerName="istio-proxy" Jul 08 18:17:20.382426 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:20.382183 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="839720af-fc9a-4dbf-b40d-5e48e7735026" containerName="istio-proxy" Jul 08 18:17:20.382426 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:20.382191 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="839720af-fc9a-4dbf-b40d-5e48e7735026" containerName="istio-proxy" Jul 08 18:17:20.382426 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:20.382291 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="1983be7d-76cb-409e-8eca-460b1e934180" containerName="istio-proxy" Jul 08 18:17:20.382426 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:20.382304 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="839720af-fc9a-4dbf-b40d-5e48e7735026" containerName="istio-proxy" Jul 08 18:17:20.382426 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:20.382317 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="839720af-fc9a-4dbf-b40d-5e48e7735026" containerName="istio-proxy" Jul 08 18:17:20.382724 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:20.382494 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="1983be7d-76cb-409e-8eca-460b1e934180" containerName="istio-proxy" Jul 08 18:17:20.385080 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:20.385060 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vzqzv/must-gather-sxz76" Jul 08 18:17:20.387711 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:20.387692 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vzqzv\"/\"kube-root-ca.crt\"" Jul 08 18:17:20.388326 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:20.388309 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vzqzv\"/\"default-dockercfg-68kf9\"" Jul 08 18:17:20.388420 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:20.388350 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vzqzv\"/\"openshift-service-ca.crt\"" Jul 08 18:17:20.392796 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:20.392776 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vzqzv/must-gather-sxz76"] Jul 08 18:17:20.403304 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:20.403284 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:17:20.466421 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:20.466392 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" limit=1024 Jul 08 18:17:20.475765 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:20.475747 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e875fb9b-9dce-4397-9a46-395f9faa5ba6-must-gather-output\") pod \"must-gather-sxz76\" (UID: \"e875fb9b-9dce-4397-9a46-395f9faa5ba6\") " pod="openshift-must-gather-vzqzv/must-gather-sxz76" Jul 08 18:17:20.475851 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:20.475835 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clcvm\" (UniqueName: \"kubernetes.io/projected/e875fb9b-9dce-4397-9a46-395f9faa5ba6-kube-api-access-clcvm\") pod \"must-gather-sxz76\" (UID: \"e875fb9b-9dce-4397-9a46-395f9faa5ba6\") " pod="openshift-must-gather-vzqzv/must-gather-sxz76" Jul 08 18:17:20.576666 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:20.576627 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clcvm\" (UniqueName: \"kubernetes.io/projected/e875fb9b-9dce-4397-9a46-395f9faa5ba6-kube-api-access-clcvm\") pod \"must-gather-sxz76\" (UID: \"e875fb9b-9dce-4397-9a46-395f9faa5ba6\") " pod="openshift-must-gather-vzqzv/must-gather-sxz76" Jul 08 18:17:20.576843 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:20.576733 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e875fb9b-9dce-4397-9a46-395f9faa5ba6-must-gather-output\") pod \"must-gather-sxz76\" (UID: \"e875fb9b-9dce-4397-9a46-395f9faa5ba6\") " pod="openshift-must-gather-vzqzv/must-gather-sxz76" Jul 08 18:17:20.577025 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:20.577011 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e875fb9b-9dce-4397-9a46-395f9faa5ba6-must-gather-output\") pod \"must-gather-sxz76\" (UID: \"e875fb9b-9dce-4397-9a46-395f9faa5ba6\") " pod="openshift-must-gather-vzqzv/must-gather-sxz76" Jul 08 18:17:20.586201 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:20.586170 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clcvm\" (UniqueName: \"kubernetes.io/projected/e875fb9b-9dce-4397-9a46-395f9faa5ba6-kube-api-access-clcvm\") pod \"must-gather-sxz76\" (UID: \"e875fb9b-9dce-4397-9a46-395f9faa5ba6\") " pod="openshift-must-gather-vzqzv/must-gather-sxz76" Jul 08 18:17:20.695389 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:20.695359 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vzqzv/must-gather-sxz76" Jul 08 18:17:20.828609 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:20.828586 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vzqzv/must-gather-sxz76"] Jul 08 18:17:20.830902 ip-10-0-130-38 kubenswrapper[2552]: W0708 18:17:20.830873 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode875fb9b_9dce_4397_9a46_395f9faa5ba6.slice/crio-d178e60c4ddf500f2383fe2f1269a31aaad68e5b98307d88c97354b5fe34e252 WatchSource:0}: Error finding container d178e60c4ddf500f2383fe2f1269a31aaad68e5b98307d88c97354b5fe34e252: Status 404 returned error can't find the container with id d178e60c4ddf500f2383fe2f1269a31aaad68e5b98307d88c97354b5fe34e252 Jul 08 18:17:20.832863 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:20.832847 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 18:17:20.907440 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:20.907409 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vzqzv/must-gather-sxz76" event={"ID":"e875fb9b-9dce-4397-9a46-395f9faa5ba6","Type":"ContainerStarted","Data":"d178e60c4ddf500f2383fe2f1269a31aaad68e5b98307d88c97354b5fe34e252"} Jul 08 18:17:21.914722 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:21.914692 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vzqzv/must-gather-sxz76" event={"ID":"e875fb9b-9dce-4397-9a46-395f9faa5ba6","Type":"ContainerStarted","Data":"ad55e894a322de8243d7ad235224b306b47df07e781d7f30b637bbcbe2b90d6f"} Jul 08 18:17:22.925243 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:22.925148 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vzqzv/must-gather-sxz76" event={"ID":"e875fb9b-9dce-4397-9a46-395f9faa5ba6","Type":"ContainerStarted","Data":"12cb28ee70fb4fbb94d078ee5172c8c8fb5a4b36d2d8f4f6777649dd19a80867"} Jul 08 18:17:22.945986 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:22.945925 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vzqzv/must-gather-sxz76" podStartSLOduration=2.035846088 podStartE2EDuration="2.94590304s" totalImagesPullingTime="910.056952ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:17:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:17:22.942478948 +0000 UTC m=+2641.178871202" watchObservedRunningTime="2026-07-08 18:17:22.94590304 +0000 UTC m=+2641.182295295" Jul 08 18:17:23.371222 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:23.371173 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6nt78_309592bc-ee3f-4203-a296-13edbb56a985/global-pull-secret-syncer/0.log" Jul 08 18:17:23.506055 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:23.506022 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hxmj2_1480d4cf-8efd-4dab-8e04-4ac6f49efcdf/konnectivity-agent/0.log" Jul 08 18:17:23.595301 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:23.595273 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-38.ec2.internal_f6230924fbe78dca7da4f87ec63109d6/haproxy/0.log" Jul 08 18:17:28.177774 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:28.177739 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd_28b489c6-2209-4551-9b1a-9708251da0ff/extract/0.log" Jul 08 18:17:28.202629 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:28.202595 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd_28b489c6-2209-4551-9b1a-9708251da0ff/util/0.log" Jul 08 18:17:28.229360 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:28.229315 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759vt4nd_28b489c6-2209-4551-9b1a-9708251da0ff/pull/0.log" Jul 08 18:17:28.276951 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:28.276921 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz_4da1d754-e7b9-440d-a83f-cc2eb4df56c0/extract/0.log" Jul 08 18:17:28.309629 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:28.309603 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz_4da1d754-e7b9-440d-a83f-cc2eb4df56c0/util/0.log" Jul 08 18:17:28.333294 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:28.333252 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0bzstz_4da1d754-e7b9-440d-a83f-cc2eb4df56c0/pull/0.log" Jul 08 18:17:28.369598 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:28.369567 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz_3c7c90ea-47a9-460f-8207-8f64130b9a96/extract/0.log" Jul 08 18:17:28.401068 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:28.400992 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz_3c7c90ea-47a9-460f-8207-8f64130b9a96/util/0.log" Jul 08 18:17:28.442606 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:28.442471 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73tpnsz_3c7c90ea-47a9-460f-8207-8f64130b9a96/pull/0.log" Jul 08 18:17:28.480182 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:28.480156 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q_76a09a05-b454-46ed-9250-69e07de573f8/extract/0.log" Jul 08 18:17:28.508615 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:28.508581 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q_76a09a05-b454-46ed-9250-69e07de573f8/util/0.log" Jul 08 18:17:28.533322 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:28.533284 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef147p5q_76a09a05-b454-46ed-9250-69e07de573f8/pull/0.log" Jul 08 18:17:28.878418 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:28.878256 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-bc745d9c6-nlc68_d18b6dd5-5528-44b3-b43f-332d6f5d753a/authorino/0.log" Jul 08 18:17:28.912102 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:28.912066 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-g59th_66a40a61-8cdb-4172-bcde-baab112536f2/manager/0.log" Jul 08 18:17:28.986821 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:28.986785 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-x4rg4_64c1ad54-5e1e-44b3-9cc5-fdd94ee0677b/kuadrant-console-plugin/0.log" Jul 08 18:17:29.044177 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:29.044143 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-zck7m_495aa8a3-5e15-44d5-88d1-da9aa34e8f50/registry-server/0.log" Jul 08 18:17:29.219035 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:29.219002 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-vgm8b_bccd334a-41a0-4757-8bef-0580f71a02cc/manager/0.log" Jul 08 18:17:31.426021 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:31.425989 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-vbzn4_6a728e39-6156-4484-91e0-d9fdf3caf22e/cluster-monitoring-operator/0.log" Jul 08 18:17:31.454099 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:31.454060 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-lq4rt_17139921-5264-4d9c-85b8-f0ed12897f22/kube-state-metrics/0.log" Jul 08 18:17:31.473430 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:31.473398 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-lq4rt_17139921-5264-4d9c-85b8-f0ed12897f22/kube-rbac-proxy-main/0.log" Jul 08 18:17:31.499894 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:31.499853 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-lq4rt_17139921-5264-4d9c-85b8-f0ed12897f22/kube-rbac-proxy-self/0.log" Jul 08 18:17:31.537361 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:31.537305 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-844cf886cf-glmng_c4cc398e-96c5-41d4-b8ed-34f85022d530/metrics-server/0.log" Jul 08 18:17:31.569522 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:31.569468 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-qz2rk_3f342cb0-b56a-4b7a-a1f4-bb746a2bfc72/monitoring-plugin/0.log" Jul 08 18:17:31.767926 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:31.767887 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s77mr_c98da5ae-30b2-4512-83e2-33c12ac50891/node-exporter/0.log" Jul 08 18:17:31.791000 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:31.790969 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s77mr_c98da5ae-30b2-4512-83e2-33c12ac50891/kube-rbac-proxy/0.log" Jul 08 18:17:31.815325 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:31.815295 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s77mr_c98da5ae-30b2-4512-83e2-33c12ac50891/init-textfile/0.log" Jul 08 18:17:33.504725 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:33.504684 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vzqzv/perf-node-gather-daemonset-54xvm"] Jul 08 18:17:33.510226 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:33.510201 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-54xvm" Jul 08 18:17:33.527313 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:33.527285 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vzqzv/perf-node-gather-daemonset-54xvm"] Jul 08 18:17:33.574174 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:33.574146 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-r5djz_84f80313-db9a-4e96-b7e0-41817cd010cd/networking-console-plugin/0.log" Jul 08 18:17:33.611918 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:33.611884 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkpv5\" (UniqueName: \"kubernetes.io/projected/e178d607-19a9-4058-bf67-52d22222630c-kube-api-access-mkpv5\") pod \"perf-node-gather-daemonset-54xvm\" (UID: \"e178d607-19a9-4058-bf67-52d22222630c\") " pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-54xvm" Jul 08 18:17:33.612107 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:33.611946 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e178d607-19a9-4058-bf67-52d22222630c-sys\") pod \"perf-node-gather-daemonset-54xvm\" (UID: \"e178d607-19a9-4058-bf67-52d22222630c\") " pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-54xvm" Jul 08 18:17:33.612178 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:33.612109 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e178d607-19a9-4058-bf67-52d22222630c-proc\") pod \"perf-node-gather-daemonset-54xvm\" (UID: \"e178d607-19a9-4058-bf67-52d22222630c\") " pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-54xvm" Jul 08 18:17:33.612178 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:33.612172 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e178d607-19a9-4058-bf67-52d22222630c-lib-modules\") pod \"perf-node-gather-daemonset-54xvm\" (UID: \"e178d607-19a9-4058-bf67-52d22222630c\") " pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-54xvm" Jul 08 18:17:33.612268 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:33.612219 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e178d607-19a9-4058-bf67-52d22222630c-podres\") pod \"perf-node-gather-daemonset-54xvm\" (UID: \"e178d607-19a9-4058-bf67-52d22222630c\") " pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-54xvm" Jul 08 18:17:33.713117 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:33.713073 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e178d607-19a9-4058-bf67-52d22222630c-proc\") pod \"perf-node-gather-daemonset-54xvm\" (UID: \"e178d607-19a9-4058-bf67-52d22222630c\") " pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-54xvm" Jul 08 18:17:33.713117 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:33.713133 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e178d607-19a9-4058-bf67-52d22222630c-lib-modules\") pod \"perf-node-gather-daemonset-54xvm\" (UID: \"e178d607-19a9-4058-bf67-52d22222630c\") " pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-54xvm" Jul 08 18:17:33.713397 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:33.713169 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e178d607-19a9-4058-bf67-52d22222630c-podres\") pod \"perf-node-gather-daemonset-54xvm\" (UID: \"e178d607-19a9-4058-bf67-52d22222630c\") " pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-54xvm" Jul 08 18:17:33.713397 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:33.713205 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkpv5\" (UniqueName: \"kubernetes.io/projected/e178d607-19a9-4058-bf67-52d22222630c-kube-api-access-mkpv5\") pod \"perf-node-gather-daemonset-54xvm\" (UID: \"e178d607-19a9-4058-bf67-52d22222630c\") " pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-54xvm" Jul 08 18:17:33.713397 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:33.713244 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e178d607-19a9-4058-bf67-52d22222630c-sys\") pod \"perf-node-gather-daemonset-54xvm\" (UID: \"e178d607-19a9-4058-bf67-52d22222630c\") " pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-54xvm" Jul 08 18:17:33.713397 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:33.713359 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e178d607-19a9-4058-bf67-52d22222630c-sys\") pod \"perf-node-gather-daemonset-54xvm\" (UID: \"e178d607-19a9-4058-bf67-52d22222630c\") " pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-54xvm" Jul 08 18:17:33.713682 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:33.713415 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e178d607-19a9-4058-bf67-52d22222630c-proc\") pod \"perf-node-gather-daemonset-54xvm\" (UID: \"e178d607-19a9-4058-bf67-52d22222630c\") " pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-54xvm" Jul 08 18:17:33.713682 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:33.713526 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e178d607-19a9-4058-bf67-52d22222630c-lib-modules\") pod \"perf-node-gather-daemonset-54xvm\" (UID: \"e178d607-19a9-4058-bf67-52d22222630c\") " pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-54xvm" Jul 08 18:17:33.713682 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:33.713634 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e178d607-19a9-4058-bf67-52d22222630c-podres\") pod \"perf-node-gather-daemonset-54xvm\" (UID: \"e178d607-19a9-4058-bf67-52d22222630c\") " pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-54xvm" Jul 08 18:17:33.722755 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:33.722725 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkpv5\" (UniqueName: \"kubernetes.io/projected/e178d607-19a9-4058-bf67-52d22222630c-kube-api-access-mkpv5\") pod \"perf-node-gather-daemonset-54xvm\" (UID: \"e178d607-19a9-4058-bf67-52d22222630c\") " pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-54xvm" Jul 08 18:17:33.823929 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:33.823845 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-54xvm" Jul 08 18:17:34.016057 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:34.015862 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vzqzv/perf-node-gather-daemonset-54xvm"] Jul 08 18:17:34.157035 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:34.157007 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-mnhqg_058a4314-4829-4b3d-a275-477b305bcf91/console-operator/1.log" Jul 08 18:17:34.163644 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:34.163625 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-mnhqg_058a4314-4829-4b3d-a275-477b305bcf91/console-operator/2.log" Jul 08 18:17:34.679060 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:34.679021 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-tqn2r_2c5bd086-641a-45bc-8e73-bc2c535cfcd5/download-server/0.log" Jul 08 18:17:35.018254 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:35.018207 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-54xvm" event={"ID":"e178d607-19a9-4058-bf67-52d22222630c","Type":"ContainerStarted","Data":"4a02c32d43d4e88862d380764b04a10cd52a4436199c95ab74f311f15d0a14e7"} Jul 08 18:17:35.018433 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:35.018274 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-54xvm" event={"ID":"e178d607-19a9-4058-bf67-52d22222630c","Type":"ContainerStarted","Data":"a63143cf9871dcbdc5aa9f37b42b9eba9487a7078eb0f2a71f2a27120bffec02"} Jul 08 18:17:35.018433 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:35.018308 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-54xvm" Jul 08 18:17:35.037165 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:35.037100 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-54xvm" podStartSLOduration=2.037079365 podStartE2EDuration="2.037079365s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:17:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:17:35.03380265 +0000 UTC m=+2653.270194904" watchObservedRunningTime="2026-07-08 18:17:35.037079365 +0000 UTC m=+2653.273471621" Jul 08 18:17:35.255448 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:35.255413 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-hjp8j_3e112127-3239-4a4f-b7bd-860ef4225433/volume-data-source-validator/0.log" Jul 08 18:17:36.323309 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:36.323284 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6nwml_eb33c2b1-0214-4114-8873-f58efeea8193/dns/0.log" Jul 08 18:17:36.347323 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:36.347290 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6nwml_eb33c2b1-0214-4114-8873-f58efeea8193/kube-rbac-proxy/0.log" Jul 08 18:17:36.490738 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:36.490702 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xbmdk_dfc4b46e-2008-40ce-b409-796fd7178d10/dns-node-resolver/0.log" Jul 08 18:17:37.112816 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:37.112790 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jlll6_e5316994-1495-49ea-a279-808cb77f0f92/node-ca/0.log" Jul 08 18:17:38.130437 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:38.130407 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf457j8k_6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a/istio-proxy/0.log" Jul 08 18:17:38.414497 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:38.414389 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-ns4kf_2378db08-f17a-4cf9-8071-418c81fc9665/payload-pre-processing/0.log" Jul 08 18:17:38.486037 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:38.486010 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-cb559779c-fbv6t_eba717c9-222d-4dcf-a495-4e79977b5a93/router/0.log" Jul 08 18:17:39.217920 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:39.217889 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ngz76_d5bdfe96-0ab4-4173-90bb-538d09c747d2/serve-healthcheck-canary/0.log" Jul 08 18:17:39.715533 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:39.715464 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-kkc6p_be4b19c2-731c-4888-9120-ab3330cd01e9/insights-operator/0.log" Jul 08 18:17:39.717605 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:39.717556 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-kkc6p_be4b19c2-731c-4888-9120-ab3330cd01e9/insights-operator/1.log" Jul 08 18:17:39.741445 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:39.741419 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lcl76_c85077e5-ea69-4b35-ae77-eaca46d27586/kube-rbac-proxy/0.log" Jul 08 18:17:39.771564 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:39.771518 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lcl76_c85077e5-ea69-4b35-ae77-eaca46d27586/exporter/0.log" Jul 08 18:17:39.795605 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:39.795574 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lcl76_c85077e5-ea69-4b35-ae77-eaca46d27586/extractor/0.log" Jul 08 18:17:41.039609 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:41.038641 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vzqzv/perf-node-gather-daemonset-54xvm" Jul 08 18:17:42.595402 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:42.595356 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b7dd476c8-j64gq_7dcd03aa-f58a-4c4e-bad6-186f0f72e41b/manager/0.log" Jul 08 18:17:42.620872 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:42.620849 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b7dd476c8-j64gq_7dcd03aa-f58a-4c4e-bad6-186f0f72e41b/copy-manifests/0.log" Jul 08 18:17:43.915787 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:43.915716 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf457j8k_6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a/istio-proxy/0.log" Jul 08 18:17:44.033470 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:44.033433 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-69b898c76d-scgsp_fd153588-605b-4f45-8253-7ec024dec50b/manager/0.log" Jul 08 18:17:44.148554 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:44.148496 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-ns4kf_2378db08-f17a-4cf9-8071-418c81fc9665/payload-pre-processing/0.log" Jul 08 18:17:44.203876 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:44.203841 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-cb559779c-fbv6t_eba717c9-222d-4dcf-a495-4e79977b5a93/router/0.log" Jul 08 18:17:45.412776 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:45.412699 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf457j8k_6c3fcbb5-7ab3-4cee-82fc-9ba77d98f34a/istio-proxy/0.log" Jul 08 18:17:45.657703 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:45.657672 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-ns4kf_2378db08-f17a-4cf9-8071-418c81fc9665/payload-pre-processing/0.log" Jul 08 18:17:45.713446 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:45.713417 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-cb559779c-fbv6t_eba717c9-222d-4dcf-a495-4e79977b5a93/router/0.log" Jul 08 18:17:49.463501 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:49.463465 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-gnjct_12e2c475-d57a-4902-a4ea-810948c00c4d/kube-storage-version-migrator-operator/1.log" Jul 08 18:17:49.464429 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:49.464410 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-gnjct_12e2c475-d57a-4902-a4ea-810948c00c4d/kube-storage-version-migrator-operator/0.log" Jul 08 18:17:50.620887 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:50.620773 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvhnq_3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa/kube-multus-additional-cni-plugins/0.log" Jul 08 18:17:50.643488 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:50.643460 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvhnq_3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa/egress-router-binary-copy/0.log" Jul 08 18:17:50.666352 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:50.666318 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvhnq_3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa/cni-plugins/0.log" Jul 08 18:17:50.688441 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:50.688407 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvhnq_3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa/bond-cni-plugin/0.log" Jul 08 18:17:50.714598 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:50.714563 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvhnq_3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa/routeoverride-cni/0.log" Jul 08 18:17:50.740408 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:50.740374 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvhnq_3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa/whereabouts-cni-bincopy/0.log" Jul 08 18:17:50.762824 ip-10-0-130-38 kubenswrapper[2552]: I0708 18:17:50.762797 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvhnq_3d6b1fe3-a51e-4743-be0f-7f1fa3aee6fa/whereabouts-cni/0.log"